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FOREWORD 


Intelligence  collection  systems  heve  proliferated  over  the  peat  several 
years,  Increasing  in  complexity  and  in  volume  of  output.  However,  there  has 
been  no  corresponding  improvement  In  the  ability  of  intelligence  personnel  to 
analyze  this  flood  of  data.  US  Army  Intelligence  and  Security  Command  (INSCOM) 
studies  and  Army  Research  Institute  (ARI)  research  indicate  that  Improved  support 
to  and  training  of  analysts  are  necessary  to  effectively  utilize  the  increased 
collection  capability  and  satisfy  increasing  danands  for  intelligence  within 
current  personnel  constraints.  INSCOM  and  ARI  therefore  initiated  a  joint  research 
program  to  provide  Improved  support  to  the  intelligence  analyst.  During  early 
discussions  of  the  Issues,  it  became  clear  that  any  procedural,  training,  organi¬ 
zational,  or  system  changes  to  support  analysis  will  be  effective  only  if  based 
upon  a  detailed  understanding  of  the  analysts'  role,  methods,  and  thought  processes 
in  intelligence  production.  The  first  need  was  to  evaluate  and  describe  the  human 
analytic  processes  underlying  intelligence  analysis,  synthesis,  and  production. 

This  report  provides  an  overview  of  the  results  of  this  research. 


The  approach  taken  in  this  project  was  to  examine  the  role  and  activities 
of  various  types  of  Intelligence  analysts,  and  to  develop  a  descriptive  model 
of  the  cognitive  processes  involved  in  analysis.  This  model  derives  in  large 
part  from  current  psychological  literature  and  does  not  provide  a  new  statement 
of  psychological  principles.  However,  these  principles  are  put  in  a  new  context, 
Intelligence  analysis.  This  report  describes  the  generalized  intelligence  produc¬ 
tion  model  and  the  cognitive  model.  Separate  reports  describe  in  detail  a  model 
of  the  production  of  imagery  intelligence  (ARI  Research  Report  1210) -antT  the  ^  f  '  • 
psychological  literature  underlying  the  cognitive  model  (ARI  Technical  Report  445)  w 


The  research  was  accomplished  by  a  government-contractor  team  under  contract 
MDA  903-78-C-2044  and  was  monitored  jointly  by  INSCOM  and  ARI.  Continuous  inter¬ 
action  and  collaboration  of  personnel  from  Operating  Systems,  Inc.,  INSCOM,  and 
ARI  Insured  a  multidisciplinary  approach  to  this  research. 

This  report  and  the  others  from  this  project  provide  a  framework  for  detailed 
examination  of  training  support  and  system  support  requirements  in  Intelligence 
analysis.  These  reports  should  be  very  useful  during  the  development  or  evalua¬ 
tion  of  training  procedures  or  materials,  aralytlc  procedures,  doctrine,  and 
system  requirements  for  automated  support  to  analysts. 
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Human  Process* a  in  Intelligence  Analysis:  Phase  I  Overview 


BRIE? 


Requirement: 

To  develop  a  framework  for  describing  and  understanding  the  procasa  of 
intelligence  analysis  as  performed  by  analysts  working  with  either  single¬ 
source  or  multi-source  data. 

Approach : 

A  series  of  structured  interviews  was  conducted  with  both  nationel  end 
strategic  level  intelligence  personnel  experienced  in  signal,  imagery,  and 
all-source  intelligence  processing  and  production.  Interviews  with  devel¬ 
opers  oi  training  materials  and  observation  of  classroom  instruction  and 
field  exercises  provided  additional  information  on  individual  and  group 
responsibilities.  Data  obtained  from  interviews  and  observations  were 
supplemented  with  documentation  and  reports  based  on  INSCOM  and  ARI  research. 
At  the  same  time  the  research  literature  on  cognitive  information  processing 
was  reviewed.  A  descriptive  model  of  the  cognitive  processes  underlying 
intelligence  analysis  was  developed  based  on  the  general  principles  derived 
from  the  literature  review  and  the  interviews  with  intelligence  personnel. 

Product : 

The  examination  of  intelligence  analysis  identified  enviromental  and 
Individual  variables  as  well  as  underlying  cognitive  processes  which  con¬ 
tribute  to  the  quality  of  intelligence.  The  model  describing  the  cognitive 
processes  of  intelligence  analysis  is  expected  to  serve  as  a  descriptive 
framework  for  understanding  all  levels  and  disciplines  of  intelligence 
analysis.  One  of  the  main  findings  is  that  intelligence  analysis  is  an 
internal,  concept-driven  activity  rether  than  an  external,  data-driven 
activity.  The  present  report  is  an  overview  of  the  project,  including  the 
cognitive  model.  A  process  model  of  imagery  intelligence  and  a  detailed 
literature  review  have  been  published  ns  separate  reports. 

The  findings  and  descriptive  cognitive  model  could  potentially  contrib¬ 
ute  to  the  improvement  of  the  quality  of  intelligence  products  by  providing 
a  better  understanding  of  the  thinking,  analyzing,  and  memory  processes  of 
intelligence  personnel.  The  model  can  be  used  to  study  management  and 
system  functions  as  well  as  to  guide  future  training  and  system  develop- 
m<  its.  The  results  will  be  incorporated  in  the  development  of  functional 
S(  reifications  for  the  All  Source  Analysis  System. 
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ABSTRACT 


A  project  was  undertaken  to  construct  a  general  daaorlptlve  model  of  the 
oognltive  activities  (mental  processes)  underlying  the  activities  of  Intelli¬ 
gence  analysis.  The  apprtach  used  to  develop  the  cognitive  model  com¬ 
bined  available  Information  on  the  way  In  which  Intelligence  analysis  Is 
performed  In  actual  work  settings  with  available  research  findings  In  cog¬ 
nitive  psychology.  The  first  step  was  to  Investigate  analytical  processing 
as  currently  practiced  in  two  types  of  single-source  analysis,  and  subse¬ 
quently  to  generalize  to  multi-source  analysis.  The  Initial  Interview  and 
observation  field  study  investigated  signal  Intelligence  (SIGINT).  A  second 
field  study  Investigated  imagery  intelligence  (IMINT)  and  resulted  In  a 
model  of  the  directly  observable  activities  of  single-source  {MINT  produc¬ 
tion.  A  questionnaire  Interview  guide  was  developed  and  used  In  deeper 
study  of  the  two  single-source  disciplines  and  multi-source  production 
activities.  A  concomitant  task  reviewed  literature  from  cognitive  psychol¬ 
ogy  for  applicability  to  the  study.  A  cognitive  model  was  developed,  and 
Intelligence  analysis  activities  were  studied  from  the  point  of  view  of  the 
model.  A  main  finding  Is  that  effective  Intelligence  analysis  Is  a  concept- 
driven  activity  rather  than  a  data-driven  one.  Project  results  have  Impli¬ 
cations  for  Improvements  In  a  number  of  areas  of  intelligence  work. 


1.  INTRODUCTION  AND  OVERVIEW 

1.1  Basic  Objectives 

The  study  entitled  Investigation  of 
Methodologies  and  Techniques  for  Intel¬ 
ligence  Analysis  (IMTIA)  has  been  aimed 
at  constructing  a  model  of  the  cognitive 
processes  underlying  intelligence 
analysis  activities.  The  present  report 
provides  a  management  overview  of  the 
project  and  Its  results.  Another  report 
[see  Cognitive  Processes  In  Intelll- 
gonom  Anelyslsi  A  Descriptive  Model 
end  Review  of  the  Literature  ]  provides 
an  expanded  version  of  Section  6  of 
the  present  report,  discussing  the 
technical  literature  basis  for  the  cogni¬ 
tive  model  In  terms  of  Interest  to  social 
sole  tists  and  technicians.  A  third 


report  [  Imagery  Intelligence  (IMINT) 
Production  Model  ]  was  produced  by 
the  IMTIA  project.  Publications  used  in 
the  project  are  Included  In  the  refer¬ 
ences. 

The  IMTIA  project  alms  to  Improve 
understanding  of  the  cognitive  activi¬ 
ties  underlying  Intelligence  processing 
and  production.  While  the  Intelligence 
cycle  and  associated  activities  are 
reasonably  well-defined  and  under¬ 
stood,  the  activities  that  go  on  In  the 
head  of  an  Intelligence  analyst  are  not. 
These  Internal  activities  have  been 
mainly  a  'black  box',  where  only  Inputs 
and  outputs  can  be  observed  and 
described,  and  the  unobservable 
processes  Internal  to  the  black  box  are 
unknown.  The  IMTIA  project  Is  directed 
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at  filling  this  void  in  tho  overall  under¬ 
standing  of  InteHlgence  processing  end 
production.  The  basic  abjective  of  the 
study  was  to  develop  a  cognitive  model 
that  would  provide  a  framework  for  the 
description  of  the  mental  processes 
ueed  In  Intelligence  analysis. 

1.2  Overview  of  Topics 

Section  1  summarizes  the  development 
approach  for  the  model  and  outlines  the 
main  results  and  conclusions.  Section  2 
through  6  ere  beeed  on  interviews  end 
observations  In  the  field.  Section  2 
describee  the  organizational  structure 
of  the  intelligence  cycle  and  treats 
Information  flow  within  that  framework. 
Section  3  presents  s  generic  model  for 
single-source  and  multi-source  Intelli¬ 
gence  production,  Jeacribes  the  core 
Information  processing  functions  of 
rssource  management,  adaptation,  end 
Interpretation,  and  outlines  task 
processes  common  to  Intelligence 
analysis.  Sections  4  end  6  describe 
environmental  end  Individual  variables 
that  affect  Intelligence  analysis  activi¬ 
ties. 

Section  6  presents  the  cognitive  model 
developed  In  the  course  of  the  study. 
The  model  Is  synthesized  from  e  review 
of  recent  cognitive  psychology  litera¬ 
ture.  This  major  section  describee  the 
structure  of  cognitive  capacities,  the 
basic  dynamic  cognitive  processes,  and 
the  cyclic  modification  of  menory  con¬ 
tents.  Section  7  describes  aspects  of 
analytic  work  In  the  light  of  the  cogni¬ 
tive  model,  and  Is  beeed  on  field  obser¬ 
vations  made  from  tho  point  of  view  of 
the  cognitive  model  ee  it  was 
developed.  The  final  section  of  the 
report,  Section  8,  presents  Implications 
of  the  cognitive  model  for  a  number  of 
erase.  Those  Include:  Improving  the 
accuracy  end  quality  of  analytic  pro¬ 
ducts;  Improving  the  management  of 


Intelligence  analysis  and  the  formulation 
of  operating  policies  end  procedures; 
Providing  criteria  for  tha  development 
and  evaluation  of  advanced  system 
designs  in  support  of  Intelligence 
analysts;  Providing  criteria  for  improving 
system  arrangements  for  performance 
feedback;  Facilitating  efforts  to 
develop  end  evaluate  training  programs 
end  training  doctrine;  and,  Providing 
assistance  In  personnel  selection, 
motivation,  end  career  planning. 

1 .3  What  Is  Intelligence  Analysis? 

The  definition  of  Intelligence  analysis 
presented  in  the  Glossary  of  intelli¬ 
gence  Terms  end  Definitions  [seo 
references]  reeds  as  follows:  "A  pro¬ 
cess  In  the  production  step  of  the 
intelligence  cycle  In  which  Intelli¬ 
gence  Information  Is  subjected  to 
systematic  examination  in  order  to 
Identify  significant  facta  and  derive 
conclusions  therefrom." 

The  problem  with  this  definition  is  that 
the  terms,  when  used  to  describe 
processes  Inside  the  "black  box",  have 
no  frame  of  reference:  What  does 
"systematic"  mean?  What  are  the  sub¬ 
processes  In  "examination"?  What 
about  "Identification"?  "significant"? 
■facts"?  "derive"?  "conclusions"? 
Although  the  cognitive  model  now  pro¬ 
vides  e  framework  for  answering  these 
questions,  no  such  model  existed  at  the 
outset  of  this  study. 

In  order  to  pursue  this  research, 
several  operating  definitions  were 
adopted.  A  basic  definition  was  that 
Intelllgancs  analysis  is  what  intelli¬ 
gence  analysts  do  —  an  understanding 
of  the  processes  of  intelligence 
analysis  and  the  cognitive  processes 
underlying  them  must  come  from  the 
analysts  themselves,  from  observing 
what  they  do  and  asking  them  about 
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A  subsidiary  definition  was  that  the 
performance  of  analytical  and  Judgmen¬ 
tal  activities  Involving  complsx  cogni¬ 
tive  processes  is  not  limtted  to  person¬ 
nel  traditionally  called  "analysts." 
Rather  —  for  the  purposes  of  this  study 
—  Intelligence  analysis  was  defined  to 
Include  a  spectrum  of  analytical  and 
Judgmental  activities  Involved  in  the 
processing  and  production  of  Intelli¬ 
gence,  where  individuals  assigned  to 
particular  roles  in  this  process  may 
spend  more  or  less  time  in  analytical 
activity  depending  on  their  assigned 
roles. 

For  example,  signal  intelligence  (SIGINT) 
voice  Intercept  operators  clearly  per¬ 
form  some  analytical  activity  in  search¬ 
ing  the  signal  environment;  however, 
much  of  their  duty  time  Is  devoted  to 
rather  rigidly  specified  collection  activi¬ 
ties,  involving  a  minimum  of  analytical  or 
Judgmental  processing.  On  the  othei 
hand,  Image  interpreters  (IMINT 
analysts)  In  a  national  strategic  facility 
are  more  continuously  Involved  In 
analytical  activity  In  searching  Imagery 
and  must  deal  with  more  complex  data 
patterns.  In  contrast  to  SIGINT  and 
IMINT  specialists,  multi-source  analysts 
devote  the  largest  proportion  of  their 
time  to  analytical  activity  and  deal  with 
complex  data  patterns  representing 
aggregations  of  single-source  data. 

1.4  The  Core  Processes  of  Intelli¬ 
gence  Analysis 

Two  assumptions  about  Intelligence 
analysis  underlie  this  research! 

1.  First,  it  was  assumed  that  a  sat  of 
common  analytical  task  processes 
exists  that  crosscuts  the  various 
Intelligence  disciplines  such  as 
SIGINT,  IMINT,  and  HUMINT  (Intelli¬ 
gence  from  human  sources).  These 
common  analytical  task  processes 


sup  pert  core  information  process¬ 
ing  functions  for  intelligence 
analysis. 

2.  Second,  It  was  assumed  that  the 
Identification  of  these  common 
analytical  task  processes  was  a 
key  to  identifying  the  core  infor¬ 
mation  processing  functions  of 
most  Importance  to  intelligence 
analysis.  This  was  viewed  as  an 
Important  step  In  developing  a  cog¬ 
nitive  model  that  could  provide  an 
especially  productive  framework  for 
describing  intelligence  analysis. 

1.6  Study  Approach 

The  approach  to  identifying  the  set  of 
common  analytical  task  processes  and 
developing  a  generic  cognitive  model 
based  on  these  was  first  to  Investigate 
analytical  processing  as  currently  prac¬ 
ticed  In  two  types  of  single-source 
analysis,  and  then  to  generalize  the 
findings  to  the  multi-source  analysis 
environment  where  possible.  As  shown 
In  Figure  1-1,  the  assumptions  dis¬ 
cussed  above  and  the  Initial  concepts 
regarding  the  nature  of  thn  analytic 
task  converged  to  produce  the  cogni¬ 
tive  model  described  In  Section  6.  The 
work  represented  In  the  top  half  of  Fig¬ 
ure  1-1  was  a  date-gathering,  analysis, 
and  synthesis  effort  directed  at  defin¬ 
ing  the  process  of  intelligence  analysis 
as  performed  by  Its  practitioners.  The 
work  represented  In  the  bottom  half  of 
the  figure  was  directed  at  defining  the 
underlying  processes  of  intelligence 
analysis  In  terms  of  -cognitive  functions. 
The  cognitive  model  thus  Is  a  blending 
of  the  information  gathered  and  gen¬ 
erated  in  answering  these  two  ques¬ 
tions. 
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Figure  1-1 .  The  otudy  Approach 


1.5.1  Study  of  SIGINT  Production 
Model 

The  Initial  task  involved  a  preliminary 
Investigation  of  signal  Intelligence  to 
Identify  those  SIGINT  task  processes 
which  appear  to  have  a  high  analytical 
and  judgmental  content.  These  were 
selected  for  further  study  directed  at 
understanding  the  underlying  cognitive 
processes.  The  basis  for  the  initial 
investigation  was  the  SIGINT  production 
model  prepared  for  INSCOM; 

[  SIGINT  Production  Model ,  Technical 
Report  ]. 


7.5.2  Development  of  the  IMINT  Pro¬ 
duction  Model 

The  second  intelligence  discipline 
investigated  was  imagery  intelligence. 
Since  no  comparable  production  model 
existed  for  IMINT,  the  model  described 
in  [  Imagery  Intelligence  (IMINT)  Pro¬ 
duction  Model  ]  was  developed  in  the 
course  of  this  study  to  serve  as  a  basis 
for  selecting  IMINT  task  processes 
involving  high  analytical  and  Judgmental 
content.  The  selected  processes  were 
compared  with  similar  SIGINT  task 
processes  in  order  to  provide  an  initial 
definition  of  common  analytical  task 
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processes  that  crosscut  the  Intelli¬ 
gence  disciplines. 

1J5.3  Preparation  of  Questionnaire  for 
Detailed  Information  Collection 

The  basis  for  development  of  the  IMIN7 
production  model  was  the  Intelligence 
processing  behavior  of  IMINT  analysts. 
|n  order  to  systematically  cd'act  infor¬ 
mation  on  IMINT  analysis  and  to  develop 
more  extensive  Information  c.  SIQINT 
analysis  as  well,  a  detailed  question¬ 
naire  was  prepared  for  interviewing 
Intelligence  personnel  in  both  single¬ 
source  and  multi-source  Intelligence 
production  activities. 

The  questionnaire  covered  the  following 
areas  of  questions  for  each  interview 
respondent: 

e  Domain  Definition  -  respondent’s 
client  orientation,  mission,  area  of 
responsibility,  Input  types,  infor¬ 
mation  sources,  knowledge  base, 
product  types. 

e  Percepts  and  Concepts 
respondent's  perceptual  modes 
and  skills,  mental  imagery  types, 
dlfflcult/easy  tasks. 

e  System/ Procedural  Contexts 

patterns  of  communication  activi¬ 
ties,  management  and  quality  con¬ 
trol  arrangements,  In  rpretlve 
aids  and  references,  procedural 
flexibilities  experienced  by 
respondent  In  work  setting. 

e  Decision  Processes  -  respondent’s 
view  of  work  setting  situation  with 
regard  to  conditions  for  making 
Interpretation  decisions,  interpre¬ 
tation  decision  controls,  adapta¬ 
tion  decision  mechanisms  used, 
and  prevailing  adaptation  arrange¬ 
ments. 


#  Motivational  Aspects 

respondent’s  views  of  career  path 
models,  personal  goals  and  expec¬ 
tations,  goal  attainment  criteria, 
relevant  skills  and  knowledge 
base  development. 

7  J6A  Site  Visits  and  Analyst  Inter¬ 
views 

The  questionnaire  was  used  as  a  basis 
for  conducting  the  Interviews  listed  in 
Figure  1-2.  Although  a  number  of 
relevant  Army  and  DoO  manuals  and 
reports  also  provided  Important  basic 
data  for  this  study  (see  references), 
the  richest  source  of  information  was 
the  community  of  analysts  interviewed 
and  observed  as  they  carried  out  their 
work. 

Of  particular  Interest  are  the  terms 
analysts  use  to  refer  to  themselves  and 
their  work.  They  often  see  themselves 
as  "detectives,1*  "historicns;11  their 
work  Is  like  "solving  a  mystery,"  a  "puz¬ 
zle,"  requiring  "deduction,"  "imagina¬ 
tion,"  and  "complete  concentration." 
The  guiding  principle  Is  not  only  to  look 
and  to  listen  but,  more  Importantly,  to 
think. 

These  concepts  provided  Insights  into 
the  identlficetion  of  the  core  analytic 
functions  and  the  cognitive  mechanisms 
underlying  them.  The  evolving  cognitive 
model  was  updated  and  refined  in  terms 
of  data  that  indicated  significant  vari¬ 
ables  in  the  analytical  environment 
(described  in  detail  in  Section  4.1),  in 
Individual  training,  experience,  and 
knowledge  base  development  (Section 
4.2),  and  in  key  processes  in  the 
analyst’s  cognition  (Section  6). 

7 .6.5  Selection  of  Analytical  Process¬ 
ing  Functions  for  In-  Depth  Study 

In  both  the  SIQINT  and  IMINT  studies,  a 
set  of  analytic  processes— identified  as 
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MONTH 

ORGANIZATION 

NO.  INTERVieWS/BPECIALTIES 

mo veme* 

ARMY  INTELLIGENCE  AND  SECURITY  COMMAND  (INSCOM) 
NATIONAL  SECURITY  AGENCEY  (NSA) 

2/SIGINT 

6/SIGINT,  2/IMINT 

DECEMBER 

INSCOM 

NATIONAL  PHOTOGRAPHIC  INTERPRETATION  CENTER  (NPIC) 

3/IMINT 

6/IMINT 

MARCH 

626  Ml  GP,  MIBARS,  FT.  BRAGG 

ARMY/AF  EXERCISE,  SHAW  AFB 

3428  TECH  TRAINING,  OFFUTT  AFB 

USAICS,  FT.  HUACHUCA 

INSCOM 

NPIC 

10/IMINT 

1 2/IMINT 

S/IMINT 

1 3/IMINT,  2/SIGINT 

3/IMINT 

1/IMINT 

APRIL 

FT.  DEVENS 

lO/SIG'.NT 

JUNE 

BLUE  FLAG.  EGLIN  AFB 

6/MULTI-SOURCE 

JULY 

FORSCOM  EXERCISE.  FT.  A.P.  HILL 

CPAR,  FT.  MEADE 

16/KULTI-SOURCE 

B/SIGINT 

AUGUST 

DETERMINED  EAGLE  FTX,  FT.  BLISS 

12/MULTI-SOURCE 

TOTALS 

SIGIHT  ■  28  INTERVIEWS 

IMINT  -  66  INTERVIEWS 

MULTI-SOURCE  -  33  INTERVIEWS 

1 1 7  INTERVIEWS  TO  DATE 

Figure  1  -2.  Summary  of  Sit  as  Vtoltad  for  Data  Gatharlng 
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serving  functions  common  across  the 
disciplines  of  SIGINT,  (MINT,  HUMINT, 
and  multi-source  Intelligence—  was 
selected  for  further  analysis  and 
cross-discipline  comparison. 

The  following  criteria  were  used  to 
select  analytic  processes  incorporating 
common  functions: 

e  Analytical  orientation  -  whether 
the  process  Is  mainly  analytical  or 
primarily  control  and  management 
oriented. 

e  Generality  -  whether  the  process 
appears  general  o  intelligence 
analysis  or  specific  to  the  particu¬ 
lar  discipline  of  SIGINT  or  IMINT. 

e  interpretive  Complexity 
whether  the  process  involves 
sparse,  possibly  conflicting,  data 
that  is  subject  to  many  potential 
interpretations,  or  detailed  and 
unambiguous  data  whose  interpre¬ 
tation  is  relatively  straightforward. 

e  Level  of  Aggregation  -  whether 
the  procass  involves  discrete, 
low-level  data  patterns  or  a  more 
abstract  level  of  information  that 
has  been  aggregated  one  or  more 
times  (for  example,  SIGINT  target 
detection  versus  multi-source 
fusion). 

Figure  1-3  shows  an  Initial  selection 
chart  for  IMINT  processes  in  terms  of 
these  criteria  (abbreviated  to  ANAL, 
GEN,  1C,  and  LOA,  respectively).  The  L, 
M,  and  H  labels  in  the  figure  indicate 
the  evaluation  of  each  process  as  rela¬ 
tively  low,  medium,  or  high  with  respect 
to  the  given  criterion.  Processes  that 
were  evaluated  as  low  in  analytical 
orientation  or  generality  across  ail  three 
processing  phases  were  not  selected. 
The  processes  selected  are  boxed  in 
the  figure. 


For  purposes  of  comparing  SIGINT  and 
IMINT,  the  following  analytic  processes 
common  to  both  were  selected: 

e  Search 

e  Target  Detection 

e  Target  Identification 

e  Yerget  Development 

e  Unusualness  Analysis 

a  Functional  Analysis 

s  Complex  Studies  (e.g.,  OB 
Analysis) 

e  Associated  Reporting  Processes 

7.5.6  Comparison  of  SIGINT  and  /MINT 
Analysis 

Using  the  common  task  processes 
selected  above  as  a  framework,  com¬ 
parisons  were  made  between  SIGINT 
and  IMINT  along  the  following  dimen¬ 
sions,  which  are  described  in  detail  in 
Sections  2  through  6: 

•  Strategic  versus  tactical  intelli¬ 
gence  production. 

9  Environmental  and  individual  vari¬ 
ables: 

—  Type  of  data  used. 

—  Work  setting. 

—  Client  mission. 

—  Training,  experience,  and 
knowledge  base  development 
and  maintenance. 

—  Attributes  of  a  good  analyst. 

e  Use  of  complex  conceptual  models 
in  analysis. 

SIGINT  and  IMINT  are  generally  per¬ 
ceived  as  entirely  different  because  of 
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1C  -  Interpretive  Complexity 
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ANAL  -  Analytic  Orientation 
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Figure  1  >3.  Analytic  task  processes  selected  for  additional 
study  are  enclosed.  Any  activity  scoring  low  In  GEN  or  ANAL  for 
the  three  processing  phases  was  eliminated  for  further  study. 


the  dissimilar  modes  of  data  capture 
and  resulting  perceptual  differences 
(hearing  signals  and  viewing  signal- 
analysis  displays  versus  viewing 
terrain-based  imagery).  In  fact,  some 
rather  striking  parallels  emerged  from 
the  comparison  of  SIGINT  and  IMINT 
analysis.  The  most  significant  of 
these  was  the  use  of  complex  con¬ 
ceptual  models  in  analytical  work. 

A  conceptual  model  consists  of  a  pat¬ 
tern  of  generalizations  about  a  given 
category  or  range  of  experience,  which 


depicts  a  relation  or  relations  between 
two  or  more  entities,  where  an  entity 
may  be  an  object,  an  individual,  or  an 
event. 

For  example,  IMINT  analysts  may  have  a 
conceptual  model  of  a  surface  to  air 
missile.  In  which  the  model  depicts  a 
functional  interdependency  between  a 
missile  and  its  transporter.  If  they  then 
see  a  missile  transporter  with  no  missile 
on  It,  they  may  search  the  surrounding 
area  for  places  of  storage  or  conceal¬ 
ment  for  the  missile.  Examples  of  more 


complex  conceptual  models  are  the 
Ideas  of  a  communications  net,  an  Order 
of  Battle,  a  Table  of  Organization  and 
Equipment,  the  general  relationships 
between  terrain  physical  characteris¬ 
tics  and  mobility  characteristics,  a  col¬ 
lection  system,  etc. 

Another  Important  parallel  between  SIG- 
INT  and  IMINT  analysis  emerged  from 
what  analysts  saw  as  the  key  attri¬ 
butes  of  u  good  analyst.  Both  SIGINT 
and  IMINT  analysts  stated  that  a  good 
analyst  Is  a  "detective",  that  Is,  one 
who  discovers  what  Is  concealed  or 
tends  to  elude  observation,  one  who  is 
solving  a  mystery  or  a  puzzle.  The 
effective  analyst  must  have  "imagina¬ 
tion"  In  order  to  generate  good 
hypothec'  a  about  what  is  happening 
and  what  might  be  concealod,  and  to  do 
some  "detective  work"  to  collect  evi¬ 
dence  that  confirms  or  refutes  these 
hypotheses.  It  Is  Important  to  "be  a 
historian”  because  one  must  know  what 
has  happened  in  the  past  in  order  to 
understand  what  Is  happening  In  the 
present  and  what  Is  likely  to  happen  In 
the  future. 

The  major  differences  between  SIGINT 
and  IMINT  analysis  are  attributable  to 
differences  in  modes  of  data  capture 
and  resulting  different  perceptual 
requirements.  Several  of  the  SIGINT 
specialties  require  a  great  deal  of 
specific  data-capture  training 
(language,  morse)  In  addition  to  general 
training  in  military  science  (and  other 
areas  discussed  In  Section  6).  IMINT 
analysts  on  an  inactive  mission  may 
devote  off-duty  time  and  Idle  time  on 
duty  to  Increasing  their  general 
knowledge  about  the  geography  and 
cultural  background  of  the  <irea  or  mis¬ 
sion  responsibility,  or  about  types  urf 
military  equipment  likely  to  appear  In 
Imagery  generated  during  exercises. 


While  IMINT  analysts  are  able  to  spend 
time  In  building  and  maintaining  the 
store  of  conceptual  models  that  forms 
the  Internal  knowledge  base,  SIGINT 
analysts  on  an  Inactive  mission  are 
more  concerned  with  not  losing 
language  or  morse  proficiency,  rather 
than  with  Increasing  or  maintaining  gen¬ 
eral  or  military  knowledge. 

Both  SIGINT  and  IMINT  analysts  find 
assignments  to  Inactive  missions  In  the 
tactical  environment  frustrating 
because  they  like  their  analytical  work 
and  know  that  lack  of  practice  leads  to 
loss  of  proficiency.  The  SIGINT  analysts 
have  more  to  lose  In  such  a  situation, 
since  data-capture  mode  knowledge 
(language,  morse),  as  v/ell  as  general 
and  military  knowledge,  will  Inevitably 
degrade. 

Similarly,  although  both  SIGINT  and 
IMINT  analysts  prefer  analysis  to 
management,  SIGINT  analysts  who 
moved  to  management  positions  where 
their  voice  or  morse  proficiency  was  not 
used  expressed  the  most  frustration 
because  of  the  substantial  amount  of 
time  they  haa  devoted  to  their  early, 
extensive,  career  training. 

In  general,  the  similarities  between  SIG¬ 
INT  and  IMINT  analysis  far  outweigh  the 
specific  differences  attributable  to  dif¬ 
ferent  data-capture  modes  and,  conse¬ 
quently,  to  different  modes  of  percep¬ 
tion. 

1.5.7  Extension  of  the  Comparison  to 
HUMINT  and  Multi-Source  Analysis 

Although  a  detailed,  Intensive  Investiga¬ 
tion  of  HUMINT  was  not  within  the  scope 
of  the  study,  some  observations  of 
HUMINT  analysts  at  work  were  made 
and  several  discussions  were  held  with 
IPW  (Interrogation  of  Prisoners  of  War) 
analysts.  For  the  most  part,  it  appears 
that  the  generalizations  about  SIGINT 


language  specialists  made  In  the 
preceding  section  also  apply  to  HUMINT 
analysts.  A  major  difference  Is  the 
greater  Importance  of  special  verbal 
skills  for  HUMINT  analysts,  who  spend 
many  hours  Interviewing  In  a  foreign 
language.  Anouter  difference  is  the 
relatively  greater  Importance,  for 
HUMINT  analysts,  of  access  to  multi- 
source  Information,  which  provides  them 
with  tiie  necessary  knowledge  base  for 
helping  to  elicit  Information  from  per¬ 
sons  being  Interviewed. 

Extending  the  comparison  to  multi¬ 
source  analysis,  the  major  differences 
between  single-source  and  multi-source 
analysis  Involve: 

e  higher  levels  of  aggregation  of  the 
Information  to  be  analyzed  In 
multi-source,  and  to  some  extent, 

e  greater  Interpretive  complexity  lot 
multi-source  because  of  the  rela¬ 
tively  greater  number  of  concep¬ 
tual  models  to  be  considered. 

1.6  Conclusions  and  Implications  for 
the  Cognitive  Model 

The  most  telling  result  of  this  study  Is 
the  clear  implication  that  Intelligence 
analysis  Is  conceptually  driven  as 
opposed  to  data  driven.  What  Is  critical 
Is  not  just  the  data  collected,  but  also 
what  Is  added  to  those  data  In  Inter¬ 
preting  them  via  conceptual  models  In 
the  analyst’s  store  of  knowledge. 

The  most  Important  parallel  between 
SIGINT,  IMINT,  HUMINT,  and  multi-source 
analysis  Involves  the  use  of  a  large 
variety  of  complex  conceptual  models 
In  analytic  activities. 

The  core  functions  of  Intelligence 
analysis  Involve  the  use  of  complex 
conceptual  models.  In  turn,  the  use  of 
such  models  Is  dependent  upon  Indivi¬ 
dual  variables  such  as: 


e  Ability  to  acquire  anti  comprehend 
complex  conceptual  models. 

e  Ability  to  generate  end  evaluate 
new  conceptual  models 
(hypotheses). 

e  Knowledge,  consisting  of  a  general 
mental  Inventory  of  available  con¬ 
ceptual  models.  Including  mental 
"Index"  to  locations  of  models  in 
external  memory  (In  the  form  of 
colleagues,  files,  references,  aids, 
etc.). 

e  Accurate,  reliable  memory  func¬ 
tioning. 

e  Special  Interests  and  orientations 
toward  conceptual  modeling  as  an 
activity  in  Its  own  right.  Including 
explicit  recognition  of  models  as 
mental  phenomenon,  and  selective 
attention  and  selective  memory  for 
certain  kinds  of  conceptual 
models. 

e  Mental  flexibility  and  ability  to 
loam  from  past  experience. 

The  use  of  such  models  is  also  depen¬ 
dent  upon  environmental  or  work  settle, 
variables  impacting  the  analytic  pro¬ 
cess,  such  as: 

e  Client  orientations  (support  of  tac¬ 
tical  versus  strategic  command, 
Indications  and  Warning,  mission 
ops,  plans,  logistics). 

e  Production  management  and  task¬ 
ing  (mission,  area  of  interest,  pro¬ 
duct  accounting,  tasking  agencies, 
work  breakdown  structure). 

e  Information  acquisition  (collection 
plan,  collection  gaps,  predictabil¬ 
ity). 

e  Domain  (geographic  areas, 
sociocultural  characteristics,  ter¬ 
rain  features,  weather, 
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economics). 

•  Oats  types  (sensor  types, 
observers,  filtered  data,  analytical 
results,  expectations). 

e  Judgmental  factors  (priorities,  timo 
available,  communication 

bandwidth,  significance). 

e  System  supports  (displays,  data 
bases,  colleagues,  references, 
computational  aids). 

Because  both  individual  and  environ¬ 
mental  variables  affect  the  analyst’s 
cognitive  performance,  the  model  of 
cognitive  processes  underlying  intelli¬ 
gence  analysis  must  show  sensitivity  to 
these  vrriables. 
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ngura  2-1.  Structure  of  Relation*  Between  Analytic  Specialities 


2.  FRAMEWORK  FOR  INTELLIGENCE 
ANALYSIS  COMPARISONS 

The  main  dimensions  for  comparing  intel¬ 
ligence  analysis  specialities  are 
reflected  In  the  work  settings  in  which 
the  specialities  are  performed.  These 
dimensions  include  differences  In 
amounts  and  modes  of  data  to  be 
analyzed,  assigned  domain  from  which 
data  are  generated,  kinds  of  analytic 
tasks  to  be  performed  on  the  data,  the 
general  range  end  conceptual  level  of 
concerns  that  are  to  be  brought  to  bear 
in  considering  the  data,  and  the 


particular  context  within  which  the  work 
setting  resides.  Analysis  of  the  overall 
organization  of  intelligence  production 
activities  In  such  terms  led  to  the 
development  of  the  multi-dlmenslonal 
structure  shown  In  Figure  2-1,  which 
depicts  work  settings  for  various  types 
of  SIGINT,  IMINT,  and  HUMINT  process¬ 
ing,  and  their  relation  to  work  settings 
In  which  higher  levels  of  intelligence 
data  processing  are  accomplished. 

The  bulk  of  Figure  2-1  consists  of  four 
interconnected  sets  of  columns  deplet¬ 
ing  the  overall  Intelligence  system.  At 
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the  left  of  tho  figure  la  shewn  tha  Intal- 
Nganoa  Information  cycle,  which  con¬ 
sists  of  a  generalized  saquanoa  of  four 
Information  procasslng  phasas  that 
occur  throughout  tha  system  at  most 
levels  and  for  moat  modas  of  data: 

a  Collection  of  data  that  la  Indies- 
th/e  of  oapabllltlos  or  Intantlona. 

a  First  phaaa  exploitation  of  data 
(high  threat  and  limited  response 
time  window). 

a  Second  phase  exoi  cation  of 
data  (for  current  j  rations  and 
situation  assessment). 

a  third  phaaa  exploitation  of  data 
to  support  basic  Intelligence 
needs  and  special  requirements, 
and  review  of  conceptual  models 
used  to  Interpret  data. 

2.1  Organizational  Structure  of  Intel¬ 
ligence  Analysis  Tasks 

Tha  main  types  of  settings  for  Intelli¬ 
gence  analysis  are  portrayed  across 
Figure  2-1  from  left  to  right: 

a  Various  inodes  of  Intelligence  col¬ 
lection  (SIGINT,  IMINT,  HUMINT). 

a  Single-source  correlation  and  pro¬ 
duction. 

e  Multi-source  aggregation  and 
futlon  (over  time  and  aourcea) 
ac  ordlng  to  mission  orientation 
(IPB,  Targeting,  Situation  Assess¬ 
ment,  OPSEC). 

e  Specific  client-oriented  Informa¬ 
tion  product  packaging. 

In  the  figure,  main  data-flow  paths  are 
om  left  to  right,  with  a  corresponding 
ti ■crease  In  segregation  of  data. 

2.2  Communication  Factors 

Besides  the  main  data  flows,  Flgura  2-1 
Indicates  that  the  various  types  of  work 


settings  are  also  linked  by  four  kinds  of 
communication  factors: 

a  Communication  modais. 

a  Formal  Information  flow  arrange¬ 
ments. 

a  Informal  communications. 

o  Job  rotation. 

Each  of  these  are  considered  below. 

2.2.7  Communication  Models 

A  communication  modal  is  a  common 
conceptual  modal  shared  by  parties  who 
use  It  as  a  means  of  communication. 
Such  shared  conceptual  models  link 
Intelligence  work  settings.  As  defined 
earlier,  a  conceptual  modal  consists  of 
a  pattern  of  generalizations  about  a 
given  category  or  range  of  experience, 
which  depicts  a  relation  or  relations 
between  two  or  more  entities,  where  an 
entity  may  be  an  object,  an  Individual, 
or  an  event.  Shared  conceptual  models 
are  the  basis  for  common  understand¬ 
ings  of  many  mutual  concerns,  Including 
the  characteristics  of  intelligence  tar¬ 
gets,  collection  capabilities,  use  of  col¬ 
lection  capabilities,  and  the  operating 
environment  These  models  are 
reflected  in  training  plans,  In  operating 
doctrine,  and  l'i  knowledge  bases  used 
by  analysts. 

2.2.2  Formal  Information  Flow  Arrange¬ 
ments 

Linking  the  different  special  work  set¬ 
tings  are  flows  of  information  through 
formal  communication  channels  (record 
and  message  traffic,  mail,  command  and 
control  communications  networks,  writ¬ 
ten  orders,  etc,).  These  carry  require¬ 
ments,  tasking,  raw  data,  filtered  data, 
and  analytical  results  and  products. 
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2.2. 3  Informal  Communications 

Informal  communications  (via  secure 
telephone,  meetings,  consultations  with 
peers,  interactive  digital  communica¬ 
tions  networks,  and  personal  le*.sr.«) 
link  the  work  settings,  provlclrg 
analysts  with  clarifications,  feedback, 
and  ready  extensions  of  their  own 
analytical  capabilities.  A  function  often 
served  by  Informal  communications  is 
that  of  making  analysts  aware  of  larger 
perspectives.  Interviewed  analysts 
observed  that  when  they  were  left 
unaware  of  the  "big  picture,"  they  felt 
Iso'ated  end  were  less  able  to  advance 
their  skills.  This  condition  was  cited  as 
being  more  prevalent  In  tactical  units 
without  an  active  mission.  Analysts  In 
strategic  facilities  do  not  exhibit  this 
concern,  because  of  larger  local  analyst 
populations  and  better  facilities  for 
sharing  information  with  other  organiza¬ 
tions. 


2.2.4  Job  Rotation 

Job  rotation  through  different  work  set¬ 
tings  serves  to  link  the  settings. 
Analysts  report  that  receiving  a  variety 
of  tactical  and  strategic  assignments 
develops  a  perspective  about  available 
Information  sources  (Including  personal 
contacts)  that  are  used  in  analysis. 
Analysts  who  have  strategic  assign¬ 
ments  prior  to  entering  the  tactical 
environment  know  where  to  obtain  tac¬ 
tically  useful  all-source  Information. 
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Figure  3-1.  Generic  Intelligence  Production  Model 


3.  GENERIC  INTELUGENCE  PRODUC¬ 
TION  MODEL 

Analysis  and  comparison  of  SIGINT, 
HUMINT,  and  multi-source  Intelligence 
production  led  to  the  development  of  a 
model  of  generic  Intelligence  production 
processes,  shown  In  Figure  3-1.  The 
model  characterizes  observable 
processes  common  to  the  three  special¬ 
ities.  The  processes  support  three 
Interrelated  generic  functions  per¬ 
formed  In  analytic  work  settings: 

e  Resource  Management 


e  Adaptation 
e  Interpretation 

Interpretation  (which  encompasses  data 
processing,  analysis,  and  reporting)  Is 
the  function  usually  considered  as  Intel¬ 
ligence  analysis.  However,  the 
resource  management  and  adaptation 
functions  are  also  Included  In  the 
present  model  because  of  their  impor¬ 
tant  effects  on  the  quality  of  the  ana¬ 
lytic  product  and  because  Interpretive 
decisions  are  often  required  for 
resource  management  <and  adaptation. 
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3.1  Resource  Managtmtirt 

The  resources  allocated  to  Intelligence 
analysis  Include: 

e  Time. 

e  Analytic  personnel  capabilities. 

e  Information  flow. 

e  Information  storage  capacities. 

e  Collection  assets. 

e  System  facilities. 

e  Resource  management  capabili¬ 
ties. 

e  Adaptive  capabilities. 

As  Indicated  In  Figure  3-1 ,  resource 
management  tasks  Include  planning, 
allegation,  and  tasking.  Each  of  these 
tasks  Involves  decision  making  by 
analysts  as  well  as  management.  Vari¬ 
ables  considered  in  resource  manage¬ 
ment  decision  making  Include: 

e  Level  of  threat. 

e  Availability  of  resources. 

e  Priorities. 

e  Short  term  vs.  long  term  benefits. 

One  of  the  most  important  managed 
resources  Is  time.  Mechanisms  used  to 
adjust  production  to  time  pressures 
Include: 

e  Segmenting  production  into  phases 
oriented  to  product  suspense 
times. 

e  Controlling  the  size  of  geographic 
area,  or  number  or  types  of  tar¬ 
gets  handled  by  one  analyst. 

e  Assigning  priorities  so  that  time- 
sensitive  data  gets  handled  first. 

In  the  context  of  producing  specific 
products,  the  analyst  makes  many 
resource  management  decisions. 


Analysts  must  frequently  support  multi¬ 
ple  missions  concurrently  and  divide 
their  time  between  several  tasks. 
Analysts  may  serve  several  clients 
when  producing  analytical  results  and 
must  make  compromise  decisions  on  for¬ 
mat  and  content.  The  analyst  must  also 
find  time  to  secure  the  long-term  bene¬ 
fits  of  skill  maintenance  and 
knowladge-base  development.  Analysts 
who  were  Interviewed  felt  that  they 
had  less  control  over  this  last  category 
than  was  necessary  to  develop  and 
maintain  their  proficiencies. 

8.2  Adaptation 

Adaptation  Is  the  development  of 
appropriate  new  responses,  by  what¬ 
ever  means,  In  the  face  of  significant 
change.  Figure  3-1  shows  the  adapta¬ 
tion  function  as  a  key  feature  of  the 
generic  intelligence  production  model. 
Adaptation  of  the  Intelligence  produc¬ 
tion  process  requires  that  both  the 
organization  and  the  analysts  examine 
the  quality  of  products  and  use  what¬ 
ever  means  are  available  to  correct 
deficiencies.  Adaptation  takes  place  at 
both  Individual  and  organ)  Jtlonal  levels. 

3.Z.1  individual  Adaptation 

It  Is  impractical  to  tightly  control  intelli¬ 
gence  production  by  external  monitoring 
and  quality-control  checks.  The  quality 
of  a  particular  piece  of  work  can  be 
checked  only  by  replicating  the  entire 
process,  using  another  analyst  with 
better  qualifications,  and  then  making  a 
comparison.  This  cannot  be  done  on  a 
large  scale  because  of  the  high  cost  of 
the  duplicative  effort.  Thus,  the  adap¬ 
tive  capabilities  of  the  individual 
analyst  are  at  a  premium,  individual 
adaptive  activities  are  exemplified  by 
the  following  behaviors  observed  during 
site  visits: 


•e  Making  voluntary  Judgments  about 
own  performance. 

•a  Seeking  Informal  feedback  chan- 
nala. 

•a  Using  non-standard  processing 
strategics  (whatever  works). 

•a  Using  own  Initiative  for  Increasing 
awareness  In  significant  areas 
(Information  entrepreneurial!)): 

—  8eeklng  cues  from  other  Intelli¬ 
gence  sources. 

—  Seeking  cues  from  associated 
elements  or  processes. 

—  Developing  contacts  In  intelli¬ 
gence  community  or  within 
facility. 

—  Developing  cultural  knowledge 
to  aid  In  distinguishing  cultural 
background  features  from  sig¬ 
nificant  data. 

—  Building  continuously  the 
knowledge  of  "how  things 
work"  to  aid  in  interpreting 
sparse  data  (e.g.,  maximum 
speed  and  incline  capacities  of 
vehicles,  weapon  ranges, 
optimum  transmitter  positioning 
requirements,  etc.) 

3.2.2  Administrative  Adaptation 

Uke  the  Individual  analyst,  the  intelli¬ 
gence  organization  utilizes  various 
adaptive  mechanisms  when  faced  with 
new  problems.  If  a  target  area  that 
was  not  being  followed  in  depth  sud¬ 
denly  becomes  important,  the  organiza¬ 
tion  may  face  several  adaptation  prob¬ 
lems: 

e  Inattention  to  the  area  may  have 
resulted  in  gaps  In  reference 
materials. 


e  Analysts  reassigned  to  the  new 
area  will  have  a  substantial 
start-up  time  to  become  familiar 
with  the  targets  and  achieve  con¬ 
fidence  In  Interpretations. 

e  Sociocultural  knowledge  may  not 
be  current  for  analysts  who  must 
work  a  new  geographic  area. 

The  administrative  adaptation  process 
Is  important  in  the  study  of  intelligence 
analysis  because  It  contributes  factors 
basic  to  analytic  performance.  One  of 
the  strengths  of  strategic  intelligence 
organizations  Is  that  they  are  able  to 
use  highly  experienced  and  qualified 
analysts  In  the  production  process. 
These  analysts  accumulate  a  large 
store  of  knowledge  on  specific  target 
areas  and  are  able  to  perform  in-depth 
interpretations.  Sociocultural 

knowledge  at  the  strategic  level  can  be 
supplemented  by  immediate  access  to 
State  Department  and  civilian  sources. 

Because  strategic  production  resources 
are  limited,  some  target  areas  must  be 
assigned  lower  priorities.  However, 
computer  data  bases  maintain  archival 
files  of  target  information  stored  earlier 
that  can  be  recovered  easily  after  long 
periods  of  lowered  attention  to  particu¬ 
lar  targets.  Such  data  serve  as  base¬ 
lines  for  renewed  closer  attention. 
Communication  networks  make  such 
data  available  on  a  shared  basis 
throughout  the  strategic  community. 

On  the  other  hand,  Intelligence  produc¬ 
tion  facilities  In  tactical  echelons  below 
corps  are  faced  with  adaptation 
requirements  every  time  the  supported 
tactical  unit  must  prepare  for  a  con¬ 
tingency  operation.  The  tactical  intelli  ¬ 
gence  unit  is  at  a  disadvantage  in 
adapting  to  new  contingencies  for  a 
number  of  reasons.  Analysts  are  likely 
to  be  less  experienced  than  at  the 
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Figure  3-2.  Sequence  for  Intelligence  Interpretation  Task 


strategic  level,  and  highly  experienced 
analysts  may  be  unavailable  to  assume 
training  roles.  Personnel  shortages  may 
draw  analysts  away  from  analytic  train¬ 
ing  duties.  If  the  unit  does  not  have  a 
current  active  mission,  analysts  may  not 
be  current  on  the  intelligence  threat 
and  may  not  be  garrisoned  In  a  location 
close  to  the  resources  needed  to  main¬ 
tain  knowledge  for  areas  of  likely 
operation.  Storage  facilities  are  often 
not  available  for  archival  data  that 
would  be  useful  In  preparing  for  a  wide 
range  of  contingencies.  Personnel 
clearances  and  billets  for  sensitive 
compartmented  Information  may  be  In 


short  supply.  Real  data  may  be  unavail¬ 
able  for  analyst's  to  work  with.  Interac¬ 
tion  with  community  intelligence 
resources  Is  sometimes  difficult. 

In  the  worst  case,  the  tactical  unit  must 
depend  almost  entirely  upon  the  Indivi¬ 
dual  skills  and  backgrounds  of  analysts 
to  adapt  to  new  operational  require¬ 
ments. 

3.3  Interpretation 

Although  the  generic  production  model 
depicts  interpretation  as  only  one  of 
three  main  analytic  functions,  It  Is,  In 
fact,  the  basic  one.  Figure  3-2  shows 
the  interpretive  processes  as  a  cycle 
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Figure  3-3.  Interpretive  Complexity  as  a  Function  of  Data  Richness 
and  Number  of  Supportable  Interpretations 


of  (1)  receiving  Incomplete  or  sparse 
data.  (2)  interpreting  the  data,  and  (3) 
formulating  the  Intelligence  product 
(messages,  estimates,  etc.).  The  cen¬ 
tral  function  of  Interpretation  involves 
making  many  Information  filtering  deci¬ 
sions  In  the  process  of  converting 
sparse  or  uneven  input  data  to  Intelli¬ 
gence  products.  The  basis  for  such 
decisions  is  usually  memory-stored  con¬ 
ceptual  models  of  the  types  of  real- 
world  objects  or  events  thought  to 
have  generated  the  data  being  Inter¬ 
preted. 

Figure  3-2  also  summarizes  our  obser¬ 
vation  that,  of  the  information  going  into 
the  Interpretive  product,  a  greater 
amount  comes  from  conceptual  models 
stored  In  memory  (both  Internal  and 
external  memory),  than  from  the  data 
being  Interpreted.  In  other  words,  Intel¬ 
ligence  analysis  is  usually  more  a 
concept-driven  than  a  data-driven 


process. 

3.3.7  Interpretive  Complexity 

Interpretive  complexity  Is  a  composite 
evaluation  of  the  relative  difficulty  of 
analytic  tasks.  Interpretive  complexity 
Is  Inversely  proportional  to  the  richness 
of  the  Input  data  and  directly  propor¬ 
tional  to  the  number  of  reasonable 
alternatives  against  which  an  Interpre¬ 
tive  decision  must  be  made.  Figure  3-3 
Illustrates  this  relationship.  Thus  situa¬ 
tions  which  are  the  most  difficult  and 
complex  to  Interpret  are  those  in  which 
there  are  few  data  available  but  for 
which  many  viable  Interpretations  are 
possible;  other  situations  in  which  there 
are  many .  data  that  point  to  a  single 
obvious  Interpretation  are  low  In  Inter¬ 
pretive  complexity. 

Another  factor  in  kiterprettve  complex¬ 
ity  Is  the  level  to  which  the  Input  data 
have  been  aggregated.  Data  may  be 


-  3-6- 


aggregated  over  periods  of  time,  over 
multiple  sources,  or  In  levels  of 
abstraction  (e.g.,  n  artillery  pieces  vs.  a 
battery).  Aggregation  of  Input  data  can 
work  positively  or  negatively  in  the 
Interpretation  process.  If  the  aggrega¬ 
tion  Is  done  properly,  the  richness  of 
the  Input  data  Is  Increased  and  Inter¬ 
pretive  complexity  is  lessened.  On  the 
other  hand,  aggregation  can  interject 
biases  due  to  normalization,  to  Incorrect 
Interpretation  In  abstraction,  or  to  remo¬ 
val  of  valid  ambiguities  in  preprocess¬ 
ing. 

Based  on  our  observations  three  con¬ 
clusions  about  interpretive  complexity 
have  been  drawn: 

a  The  more  complex  interpretation 
tasks  are  usually  performed  by 
more  experienced  analysts  better 
able  to  cope  with  higher  levels  of 
data  aggregation. 

a  Interpretive  complexity  la  often 
greater  In  work  settings  using  high 
levels  of  data  aggregation, 
because  analysts  must  make  deci¬ 
sions  on  the  interpretation  quality 
of  their  Inputs  as  well  as  make 
their  own  aggregation  choices  and 
Interpretive  decisions. 

e  There  Is  sometimes  distrust  of 
Interpretations  received  from  work 
settings  at  lower  levels  of  aggre¬ 
gation  unless  the  using  analyst 
has  trust  In  the  source. 

3j3.Z  Knowledge  used  In  Interpreta¬ 
tion 

The  requirements  for  the  knowledge 
needed  to  perform  Interpretations  have 
their  origin  in  one  common  definition  of 
Intelligence: 

Intelligence  Is  the  identification  of 
threat;  the  two  components  of  threat 
are  capabilities  and  Intentions. 


The  accurate  and  timely  identification 
of  three  requires  the  use  of  much 
sophisticated  knowledge  organized 
around  conceptual  models.  Potential 
threat  is  inferred  at  the  national  level 
from  scenarios  (conceptual  models) 
depicting  capabilities  of: 

a  Military  forces. 

e  Weapons. 

a  Strategic  industries. 

e  Economic  factors. 

e  Organization  and  distribution  of 
power. 

e  Strategic  and  tactical  dls»*  aiticn 
of  forces  and  weapons. 

o  Electronic  warfare  capabilities. 

Inferring  Intentions  to  use  such  capabil¬ 
ities  Is  more  difficult.  Conceptual 
models  of  necessary  buildup  patterns 
for  threatening  behavior  are  used  to 
Infer  current  and  future  Intentions.  The 
models  identify  categories  of  indica¬ 
tions  and  warning  signs  that  are 
observable  thmugh  collection  assets. 
Examples  of  such  indicators  are: 

e  Provocative  diplomacy. 

e  Threats/ultimatums. 

e  Hostile  political  actions. 

e  Intimidation. 

e  Minor  military  action. 

e  Major  military  action. 

e  Military  augmentation. 

•  Domestic  conflict. 

e  Exercise. 

e  Peaceful  diplomacy. 

e  Verbal  conflict. 
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In  a  parallel  process,  tactical  threat  Is 
Inferred  from  scenarios  depleting  capa- 
ollltles  of  such  things  as: 

e  Positioning  and  capabilities  of  Indivi¬ 
dual  large  weapons. 

e  Positioning  and  capabilities  of  mili¬ 
tary  units  of  significant  size. 

e  Movements  of  weapons  and  units. 

e  Positioning  and  movement  of  logisti¬ 
cal  units  and  headquarters. 

The  best-known  threat  model  Is  Order 
of  Battle  (OB).  Hie  OB  can  be  Imple¬ 
mented  In  hardcopy  or  computer  data 
base  form.  OB  provides  capability 
models  of  force  structures,  weapons, 
status,  and  disposition.  OB  also  pro¬ 
vides  Insight  Into  intentions  of  the 
forces  by  Implication  from  training, 
readiness  status,  tactics,  personality  of 
commanders,  and  strategic  or  tactical 
disposition  of  the  forces.  OB  data  is 
used  at  all  echelon  levels,  but  Is 
tailored  to  the  geographic  area  of 
responsibility  and  to  a  level  of  detail 
that  Is  meaningful  to  the  current  situa¬ 
tion. 

Indicators  of  threat  guide  the  develop¬ 
ment  of  further  Intelligence  information 
for  determining  vulnerabilities  and  plan¬ 
ning  responses.  In  planning  responses, 
behavior  modeling  Is  used  to  develop 
and  to  authenticate  models  of  possible 
antagonist  reactions.  These  models 
predict  probable  antagonist  responses 
under  given  sets  of  circumstances.  The 
Importance  of  behovloral  modeling  lies  In 
Its  ability  to  project  "what  If?"  situa¬ 
tions.  Because  of  the  predictive  nature 
of  these  models,  they  produce  specula¬ 
tive,  probabilistic  results  and  require 
continuous  refinement  and  adjustment 
to  maintain  their  usefulness. 

Other  types  of  models  frequently  used 
in  Intelligence  analysis  are: 


e  Models  of  enemy  surveillance 
capabilities  and  effects  of  terrain 
and  ECM. 

e  Political  organizations  and  control 
of  power. 

e  Command  and  control  organiza¬ 
tions. 

e  Personality  profiles. 

e  Terrain  models  for  use  In  traffica- 
blllty  or  tactical  disposition 
analysis. 

e  Ethnographic  models. 

e  Chain  of  events. 

e  Time  and  frequency  patterns. 

e  Industrial  production  models. 

e  Weapon  system  performance 
models. 

e  Economic  models, 
e  Lines  of  communications, 
e  Network  models. 

These  models  may  be  used  to  transfer 
general  characteristics  of  known 
threats  to  unknown  threats  by  analogy, 
and  to  develop  higher  levels  of  threat 
Information  by  piecing  together  incom¬ 
plete  fragments  of  data  (such  as  in  the 
Cuban  missile  crisis,  when  the 
existence  of  Soviet  missiles  in  Cuba 
was  ascertained  from  the  shapes  of 
shipboard  containers  and  from  tracks  of 
heavy  vehicles  around  similar  shapes 
seen  Inland). 

3.3.3  Using  Interpretive  Models 

The  main  processes  of  interpretation 
involve  the  extensive  use  of  concep¬ 
tual  models.  The  skills  that  enable  the 
analyst  to  exploit  conceptual  models 
Include: 


•  Formulation  of  conceptual  models. 

e  Storage  and  retrieval  of  data 
using  models  as  the  Indexing 
framework  (such  as  situation 
overlays,  06,  Installation  flies). 

e  Communication  with  clienta  by  use 
of  models  to  provide  extensive 
information  to  supplement  the  con¬ 
tent  of  messages  (such  as  clients 
who  have  local  OB  files,  mission 
plans,  IPB  overlays,  etc.). 

e  Correlation  of  observable  real 
world  events  with  model  parame¬ 
ters  to  deduce  capabilities  or 
Intentions  (such  as  matching  unit 
maneuvers  to  the  beginning  of  a 
mobilization). 

e  Use  of  models  to  Inductively 
determine  the  threat  from  unknown 
elements  where  analogies  exist  to 
krxnvn  threats  (such  as  extrapola¬ 
tion  of  Soviet  military  doctrine  to 
satellite  countries). 

e  Inference  of  event  significance  by 
carrying  cause  and  effect  rela¬ 
tionships  to  logical  ends  (such  as 
Impacts  of  weapon  augmentation). 

e  Fusion  of  data  by  abstracting  to 
higher  levels  of  behavior  (such  as 
lower  echelon  units  into  higher 
echelon  units  or  Individual  targets 
Into  target  clusters). 

e  Compensation  for  Incomplete  Intel¬ 
ligence  data  by  flll-ln  from  models 
(such  as  using  unit  identification 
and  location  to  Identify  probable 
locations  of  associated  units). 

e  Attention  to  serendipitous  events 
that  do  not  correlate  with  known 
models  (such  as  detecting  a  new 
weapon  system  that  Is  dis¬ 
tinguished  from  an  old  system  only 
In  one  externally  observable 


characteristic). 

e  Interpretation  of  ambiguities  by 
matching  to  multiple  f  odels  (such 
as  a  unit  that  could  belong  to 
either  a  motorized  rifle  regiment  or 
a  tank  regiment). 

e  Recognition  of  uncertainty  in 
Interpretations  by  determining  par¬ 
tial  matching  of  events  to  models 
(such  as  being  able  to  locate  and 
identify  only  60%  of  the  maneuver 
units  In  an  observable  force 
whose  structural  model  calls  for 
40%  more). 

3.3.4  Filtering  of  Products 

In  addition  to  the  conceptual  model  han¬ 
dling  skills,  the  intelligence  analyst  must 
have  the  Important  decision-making 
capability  of  controlling  and  filtering 
data  output  to  the  client.  In  deciding 
which  information  should  be  passed  on 
to  the  client,  the  analyst  uses  at  least 
these  three  mechanisms: 

e  Determining  change  from  previous 
products. 

e  Understanding  the  needs  of  the 
client  and  utilizing  Informal  feed¬ 
back  to  adjust  the  content  of  pro¬ 
ducts  or  provide  clarifications. 

e  Structuring  the  output  product 
form  such  that  it  is  self-defining  in 
terms  of  Its  relation  to  clients’ 
areas  of  interest  and  quality  of 
interpretation. 

The  control  of  Intelligence  product 
dissemination  is  largely  a  manual  pro¬ 
cess  Involving  large  distribution  lists 
that  evolve  over  an  extended  period  of 
time.  In  some  work  settings,  an  analyst 
must  designate  action  and  information 
recipients,  select  a  product  form, 
assign  precedence,  and  select  a 
transmission  mode.  These  decisions 
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determine  the  content  and  speed  of 
delivery  of  the  product 

Intelligence  products  that  are  highly 
formatted  and  transmitted  electrically 
may  be  processed  directly  Into  client 
computer  data  bases.  When  the  client 
does  not  have  computer  assistance,  the 
product  flow  rate  must  be  controlled  by 
the  intelligence  production  source  to 
prevent  saturation  of  foe  routing  sys¬ 
tem  and  the  recipients. 

3.3.6  Summary  of  Intelligence  Produc¬ 
tion  Model  Characteristics 

To  summarize,  the  generic  model  of 
Intelligence  production  processes  Iden¬ 
tifies  three  main  functional  areas: 
adaptation;  resource  management;  and 
Interpretation.  The  general  types  of 
tasks,  such  as  monitoring  and  evalua¬ 
tion,  production  planning,  tasking,  pro¬ 
cessing,  analysis,  reporting,  and  special 
product  design  serve  these  three  main 
functional  areas. 

The  central  function  of  interpretation 
involves  making  many  information  filter¬ 
ing  decisions  In  the  process  of  convert¬ 
ing  sparse  or  uneven  input  data  to 
Intelligence  products.  The  basis  for 
such  decisions  Is  usually  memory-stored 
conceptual  models  of  foe  types  of 
real-world  objects  or  events  thought  to 
have  generated  the  data  being  inter¬ 
preted. 

Comparison  of  foe  information  consti¬ 
tuents  of  intelligence  products  with  the 
Information  constituents  of  the  data 
supporting  the  products  shows  that 
often  a  large  proportion  of  the  informa¬ 
tion  In  foe  products  has  been  added 
from  memory.  Thus,  the  Interpretive  pro¬ 
cess  Is  often  more  concept-driven  than 
data-driven. 
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4.  ENVIRONMENTAL  VARIABLES 

Environmental  or  work  setting  variables 
affecting  analytic  performance  are 
Important  in  the  development  of  the 
cognitive  model  because  they  cir¬ 
cumscribe  the  range  of  perceptions, 
decision  making  considerations,  and 
constraints  which  the  analyst  experi¬ 
ences  as  a  result  of  performing  analytic 
tasks  In  a  given  work  setting.  The 
scope  of  environmental  variables 
affecting  the  cognitive  processes  of 
analysts  Is  summarized  In  the  diagram  In 
Figure  4-1. 

4.1  Assigned  Domain 

An  assigned  domain  usually  consists  of 
geographic  boundaries  within  which 
data  representing  certain  target  types 
are  to  be  interpreted.  Deep  familiarity 
with  geographic,  climatic,  and  sociocul¬ 
tural  aspects  of  the  assigned  geo¬ 
graphic  domain  Is  a  basic  asset  to  the 
Intelligence  analyst.  Intimate  familiarity 
with  the  domain  aids  In  Identifying  mili¬ 
tarily  significant  targets  and  In  antici¬ 
pating  constraints  on  military  opera¬ 
tions.  The  domain  variables  depicted  as 
Impinging  on  the  analyst  In  Figure  4-1 
become  especially  obvious  during  a 
change  of  geographic  domain.  When¬ 
ever  an  analyst  Is  reassigned  to  a  dif¬ 
ferent  geographical  domain,  even 
though  the  types  of  targets  may  be  the 
same  the  analyst  usually  requires  a 
substantial  start-up  time  to  regain  peak 
performance  levels.  The  same  Is  true  of 
reassignment  of  target  types  within  the 
same  geographic  boundaries. 

4.2  Management  and  Tasking 

Management  directives  define  the 
domains  of  an  analyst's  geographical 
and  functional  areas  of  responsibility  In 
the  overall  production  picture.  These 
tasking  constraints  change  with  time. 
Overlaps  In  assigned  responsibilities  are 


minlm'zed  to  make  efficient  use  of  rela¬ 
tively  scarce  analytic  personnel 
resources.  Nevertheless,  requirements 
for  maintaining  overlapping  knowledge 
for  different  areas  of  responsibility  are 
very  common.  The  intelligence  commun¬ 
ity  attempts  to  develop  and  exploit 
such  overlap  through  working  groups, 
Information  distribution,  Integrated  com¬ 
puter  data  bases,  and  Informal  communi¬ 
cations. 

4.3  Client  Orientations 

Figure  4-1  shows  client  orientations 
affecting  the  analyst.  Attention  to  a 
particular  client  can  improve  the  value 
of  the  analysis  product  for  that  client. 
This  goal  Is  sometimes  difficult  for  the 
analyst  to  achieve  in  practice,  because 
many  clients  are  simultaneously  served 
by  the  production  process  and  the  pro¬ 
duct  may  thus  require  an  inclusive  or 
compromise  format.  The  Importance  of 
one  client's  needs  over  another  also 
changes. 

Tactical  intelligence  production  units 
have  multiple  client  orientations  both  in 
garrison  and  In  deployment.  Tactical 
intelligence  units  are  typically  attached 
to  a  tactical  unit  commander,  and 
thereby  assigned  main  client.  At  the 
same  time,  the  ta  deal  intelligence  unit 
also  has  the  general  Intelligence  com¬ 
munity  as  a  client.  It  Is  important  to 
note  that  the  "perceived"  client  Is  more 
critical  than  the  actual  end  users  of  a 
product;  an  Individual  analyst  or  an 
intelligence  unit  may  adapt  to  satisfy 
some  goal,  but  the  Intended  user  Is  not 
always  the  sole  beneficiary. 

4.4  8ystem  Supports 

The  supports  available  in  the  Intelli¬ 
gence  production  facility  are  important 
to  analytic  performance.  Computational 
aids  and  secure  communications  are 
valuable  assets.  Storage  space  for 
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Figure  4-1.  Variables  in  Analytic  Work  Settings 


maps  and  secure  data  can  make  a  sub¬ 
stantial  tlifference  in  analytic  perfor¬ 
mance.  Film  processing  facilities  are 
important  to  IMINT  In  the  same  way  that 
electronic  signal  recording  and  repro¬ 
cessing  equipment  Is  Important  to  SIG- 
INT. 

4.0  Knowledge  Base 

The  knowledge  base  or  external  store' 
of  information  applicable  within  a  given 


Intelligence  environment  is  maintained  in 
the  form  of  materials  such  as  refer¬ 
ences,  archival  data  files,  and  computer 
data  base  systems.  Computer  aids  are 
thought  to  be  essential  for  extending 
the  knowledge  base  to  include  archival 
data  that  cannot  be  effectively  handled 
manually. 
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4.0  Judgmental  Criteria 

Analysts  must  exercise  Judgments  on  a 
fairly  large  number  of  dimensions. 
These  concern  the  possible  signifi¬ 
cances  of  new  data  for  the  needs  of 
various  analytic  clients,  the  moment- 
to-moment  optimum  use  of  the  analytic 
resources  actually  available  to  each 
analyst,  and  consideration  of  the  infor¬ 
mation  loads  imposed  on  various  ana¬ 
lytic  clients.  Furthermore,  these  judg¬ 
mental  factors  are  not  static:  needs  of 
clients  often  change  rapidly;  the  load  of 
Incoming  data  to  be  analyzed  changes 
continuously,  the  analytic  resources 
actually  available  to  the  analyst  often 
change,  and  the  Information  loads  on 
various  analytic  clients  also  varies.  As 
a  result  of  one  or  more  such  considera¬ 
tions,  the  analyst  must  often  modify 
task  priorities  and  the  time  allocated  to 
analytic  tasks.  In  a  crisis,  Incoming 
Intelligence  data  is  usually  voluminous, 
and  client  saturation  may  occur  if  the 
analyst  does  not  actively  filter  analytic 
results  by  significance  and  client 
needs.  This  Is  particularly  Important,  for 
example,  when  the  client  is  a  near- 
real-time  Intelligence  fusion  center. 

4.7  Information  Acquisition 

The  analyst  normally  has  no  direct 
Impact  on  collection  decisions.  How¬ 
ever,  the  analyst  usually  has  sufficient 
knowledge  of  the  collection  plan  to 
know  what  type  and  how  much  data  will 
be  produced  by  a  mission.  For  example, 
In  a  tactical  reconnaissance  mission, 
the  original  threat  analysis  may  have 
determined  the  critical  areas  for  sur¬ 
veillance  and  projected  the  types  of 
targets!  terrain,  and  concealment  to  be 
found  In  the  area.  The  analyst  may 
therefore  be  Involved  In  planning  the 
flight  path  and  briefing  the  aircrew  on 
air  defense  threats.  Additional  informa¬ 
tion  may  be  gained  by  debriefing  the 


aircrew  after  the  mission. 

4.»  Date  Types  Familtarity/skllls 

Many  analysts  are  specialized  In  one 
particular  data  mode.  This  specializa¬ 
tion  Is  formalized  by  military  occupa¬ 
tional  specialities  structured  along  the 
lines  of  data  capture  modes  (voice 
Intercept,  manual  morse,  imagery,  etc.). 
Specialties  are  also  defined  for 
analysts  who  handle  analytical  results 
rather  than  raw  data  (cryptanalyst,  OB, 
all-source). 

The  type  of  data  being  analyzed 
Impacts  the  analytic  processes  in  a 
number  of  ways.  The  related  mental 
Imagery  differs  for  various  data  modes. 
The  Information  properties  (comparative 
limitations,  strengths,  "artlfactual"  con¬ 
tributions)  of  different  data  modes 
reporting  the  "same"  phenomena  also 
vary  markedly.  The  difficulty  levels  and 
amount  of  experience  required  for 
acceptable  performances  vary  for  dif¬ 
ferent  data  modes  used  to  report  vari¬ 
ous  classes  of  phenomena.  The 
analyst’s  "mental  world  viewpoint"  is 
conditioned  by  the  particular  data  mode 
being  used. 

Very  little  cross-mode  training  exists 
until  the  analyst  moves  to  a  manage¬ 
ment  role.  Within  imagery  interpreta¬ 
tion,  there  are  many  submodes  (IR, 
SLAR,  forward  oblique,  overhead 
stereo/mono,  video)  that  an  analyst  will 
have  proficiency  with  after  a  combina¬ 
tion  of  tactical  and  strategic  assign¬ 
ments.  Substantial  skill-development 
time  is  required  to  adapt  to  the  specific 
data-capture  mode  in  all  specialties, 
and  particularly  in  SIGINT. 
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6.  ANALYST  VARIABLES 

A  majo,  conclusion  from  the  work  per¬ 
formed  on  this  project  Is  that  great 
Importance  must  be  placed  on  the  attri¬ 
butes  of  the  analysts  tasked  with  pro¬ 
ducing  Intelligence.  The  main  attributes 
needed  are  In  the  areas  of: 

e  Relevant  knowledge. 

e  Skills  (perceptual;  conceptual; 
communication). 

e  Orientation  toward  managing 
relevant  memory  resources. 

e  Personality. 

5.1  Knowledge 

The  knowledge  relevant  for  analysis 
Includes: 

e  Military  science. 

e  Science  and  technology. 

e  Sociocultural  knowledge. 

e  Sensor  mode  knowledge. 

Background  in  each  of  these  areas  aids 
the  analyst  In  performing  most  analyti¬ 
cal  tasks.  Commonalities  and  differ¬ 
ences  In  knowledge  requirements  for 
different  analytic  specialities  are 
highlighted  below. 

6.1.1  Military  Science 

Commonalities  between  SIGINT-  HUMINT, 
IMINT,  and  FUSION  specialties  Include 
an  extensive  knowledge  of  military  sci¬ 
ence  areas  Including  Order  of  Battle 
and  military  geography.  Characteristi¬ 
cally.  this  knowledge  is  acquired  In 
apeclfic  relation  to  the  targets  and 
geographic  area  within  the  analyst's 
assigned  area  of  responsibility.  The 
analyst  gradually  expands  this 
knowledge  base  by  croas-tralning  or 
reassignment  to  other  intelligence  pro¬ 
duction  facilities. 


6.1.2  Science  an>J  Technology 

Most  specialities  of  intelligence 
analysis  use  almost  all  fort  s  of  physical 
science  and  technology.  A  strong 
technical  background  helps  the  analyst 
understand  what  la  seen  br  heard  in 
data  collected  from  technically  complex 
targets  such  as  aircraft,  missiles, 
radars,  communication  nets,  factory 
complexes,  and  tho  like.  The  complex 
workings  of  waapona  systems,  commun¬ 
ications,  command  and  control  organiza¬ 
tions  and  procedures,  and  electronics 
systems  must  be  understood  for  proper 
Interpretation  of  Intelligence  data  In 
both  strategic  and  tactical  missions. 

Emphatically,  this  principle  holds  for  all 
levels  of  Intelligence  analysis  as 
defined  earlier.  Although  the  Inexperi¬ 
enced  Image  Interpreter  performing  a 
target  location  or  counting  function 
requires  much  less  general  knowledge 
and  understanding  than  an  analyst  with 
a  more  explicit  evaluation  role,  all  levels 
benefit  by  a  thorough  understanding  In 
their  area  of  responsibility. 

6.1  &  Sociocultural  Knowledge 

Knowledge  of  a  target  country's  cultur  e 
Is  valuable  In  discriminating  militarily 
significant  Items  from  non-significant 
ones.  Ethnography  helps  the  analyst 
know  where  to  look  for  significant  Items 
and  what  to  filter  out.  Sociocultural 
knowledge  Is  particularly  Important  in 
strategic  intelligence  analysis  where 
the  use  of  economic,  political,  and 
Industrial  models  may  be  Involved. 

6.1.4  Sensor  Mode  Knowledge 

Because  the  entire  Intelligence  produc¬ 
tion  cycle  Is  included  In  the  scope  of 
intelligence  analysis  activities,  the  abil¬ 
ity  to  understand  the  capabilities  of 
sensor  systems  la  a  fundamental 
knowledge  requirement.  Although  an 


Imagery  interpreter  may  not  need  to 
know  how  a  particular  camera  works, 
the  constraints  under  which  photo- 
graphic  data  la  collected  must  be 
understood  when  making  decisions 
about  collection  plans  and  the  quality  of 
Intelligence  products. 

6.2  Skills 

Skills  Involve  knowledge,  but  are  dis¬ 
tinguished  here  from  knowledge  In  terms 
of  added  requirements  for  highly  prac¬ 
ticed  performances. 

6.2.1  Perceptual  Skills 

The  phrase  perceptual  skills,  as  used 
here,  means  practiced  performances  In 
discriminating  between  things  on  the 
basis  of  subtle  differences  In  how  they 
sound  or  look.  Perceptual  skills  are 
especially  Important  for  single-source 
intelligence  production.  There  Is  a 
strong  consensus  In  the  field  that  the 
perceptual  skills  fundamental  to  SIGINT 
and  IMINT  single-source  production 
must  be  developed  by  using  real  data. 
That  Is,  the  refined  perceptual  skills 
necessary  to  Interpret  particular  kinds 
of  images  or  to  recognize  certain  voices 
or  certain  morse  or  telegraphic  itera¬ 
tors  canhot  be  fully  developed  in  exer¬ 
cises  disassociated  from  real  targets. 

The  analyst's  confidence  and  speed  in 
Interpretation  and  In  the  ability  to 
detect  significant  changes  also  depend 
heavily  on  familiarity  with  the  particular 
target  area.  A  substantial  time  period 
Is  required  to  gain  such  familiarity  even 
for  experienced  analysts.  SIGSNT 
analysts  stated  that  It  would  take  two 
to  six  months  to  adapt  to  a  new  target 
area  after  being  reassigned.  IMINT 
analysts  are  often  seml-permanentty 
assigned  by  geographic  area  and/or 
target  types  In  order  to  take  advantage 
of  the  resulting  accumulation  of  percep¬ 
tual  familiarity. 


6.2.2  Conceptual  Skills 

The  generic  '’'telllger.ee  production 
model  presented  earlier  depicts  Intelli¬ 
gence  analysis  as  predominantly 
oonoept-drlven  rather  than  data-driven. 
This  conclusion  was  reached  after 
observing  the  extensive  memory 
resources  (see  Figure  3-2)  that 
analysts  bring  to  the  production  of  most 
Intelligence  products,  and  noting  that 
much  of  the  memory-baaed  information 
waa  conceptual  In  nature.  The  produc¬ 
tion  process  Is  also  concept-driven  In 
the  sense  that  new  Intelligence  pro¬ 
ducts  can  be,  and  often  are,  produced 
In  the  absence  of  new  data.  Intelli¬ 
gence  preparation  of  the  battlefield 
(IPB)  Is  an  example  of  an  activity  that 
depends  almost  entirely  on  previously 
developed  and  stored  knowledge.  As 
Indicted  earlier  In  this  report,  highly 
experienced  and  effective  analysts 
often  appear  to  organize  the  mental 
storage  of  such  knowledge  around  con¬ 
ceptual  models.  The  analyst’s  ability  to 
deal  with  conceptual  models  grows  as  a 
result  of  experience  In  learning 
abstract  concepts.  This  type  of  learn¬ 
ing  appears  to  be  more  In  line  with  that 
rsoelved  In  higher  education  than  In 
trade  skill  teaming.  Characteristically, 
analysts  who  progress  to  higher  skill 
levels  have  had  post-high  school  edu¬ 
cation. 

6.2.3  Communication  Skills 

Foreign  language  is  of  special  Impor¬ 
tance  to  COMINT  and  HUMINT  Intelli¬ 
gence  production  for  obvious  reasons. 
From  a  general  standpoint,  language 
skills  are  vital  to  the  analyst  for  under¬ 
standing  the  meaning  of  collected  intel¬ 
ligence  even  after  It  Is  interpreted. 
Writing  and  speaking  skills  are  essential 
for  the  analyst  to  communicate  analytic 
results  to  clients. 
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6.3  Memory  Management  Orientation 

The  use  of  Information  from  memory  Is  a 
centrally  Important  factor  In  Intelligence 
analysis.  This  Includes  not  only  the  use 
of>  the  analyst’s  own  memory,  but  also 
the  use  of  external  memory  resources 
available  In  the  extended  work  setting. 
The  three  columns  of  Figure  6-1,  to  be 
discussed  In  more  detail  below,  depict 
types  of  Information  contents  available 
from  Internal  and  external  memory,  and 
from  the  functions  for 
updating/extending  external  <ofcmory. 
The  twe-way  arrows  Indicate  the 
reciprocal  flows  of  types  of  Information 


from  storage  facilities  where  they  are 
available  to  storage  facilities  where 
they  are  not.  The  one-way  arrows  Indi¬ 
cate  the  manner  In  which  use  of  tho 
other  two  sources  of  Information  is 
dependent  upon  knowledge  contained  In 
Internal  memory. 

6.3.7  Knowledge  of  Events  and  Situa¬ 
tions 

Figure  6-1  shows  that  the  analyst 
retains  an  internal  memory  store  of 
Information  on  situation  and  current 
events.  An  imagery  Interpreter,  for 
Instance,  may  become  so  familiar  with  a 
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terrain  area  as  to  ba  able  to  detect  any 
type  of  change  that  may  be  slgnh  cant 
S'jtllariy,  a  SiGIMT  analyst  may  be  able 
to  recognize  targets  on  the  basis  of 
"personality"  characteristics  that  are 
not  definable  In  terms  of  recorded  alg- 
nature  Information  or  signal  content.  An 
analyst  may  also  review  external 
memory  resources,  such  &<*  situation 
maps,  status  displays,  and  message 
traffic  files,  to  provide  cues  that, 
through  mental  association,  may  lead  to 
extending  an  area  of  search  or  expand¬ 
ing  the  possible  Interpretations. 

63.2  Knowledge  of  Procedure 

Figure  6  shows  that  knowledge  of  pro¬ 
cedure  resides  in  internal  memory. 
Other  than  manuals  for  operating  partic¬ 
ular  types  of  equipment  or  for  format¬ 
ting  products,  there  Is  almost  no  docu¬ 
mentation  on  the  detailed  procedures 
used  In  performing  analysis.  Such  pro¬ 
cedures  are  conveyed  to  the  analyst 
through  on-the-job  training.  The  neo¬ 
phyte  analyst  generally  gains  profi¬ 
ciency  by  working  closely  with  experi¬ 
enced  analysts  who  provide  assistance 
and  immediate  feedback  on  perfor¬ 
mance  and  answer  questions  on  tech¬ 
niques  and  interpretations.  This  face- 
to-face  learning  relationship  is  very 
widespread  and  recognized  as  essential 
in  Intelligence  analysis.  It  Is  referred  to 
by  some  experienced  analysts  as  the 
"oral  tradition"  of  learning  Intelligence 
analysis. 

The  oral  tradition  for  learning  ths  pro¬ 
cedural  Intricacies  of  intelligence 
analysis  emphasizes  the  Importance 
of  Informal  face-to-face  communica¬ 
tions. 

In  this  regard,  It  Is  important  that  th9 
analyst,  develop  confidence  In  the  abil¬ 
ity  to  analyze  end  at  the  same  time 
remain  comfortable  about  asking 


questions  of  colleagues  when  uncertain, 
since  this  process  continues  to  be  part 
of  many  analytic  problem-solving  situa¬ 
tions.  The  shared  group  value  for  "ego¬ 
less"  problem-solving  exchanges  was 
frequently  observed. 

633  Knowledge  of  Accepted  Judg¬ 
mental  and  Analytical  Criteria 

The  priorities  and  significance  of 
analytical  reaulta  ve  established 
through  cooperation  between  the  intelli¬ 
gence  organization  and  the  client.  At 
the  strategic  level  many  of  these  cri¬ 
teria  are  long-lived,  in  tactical  environ¬ 
ments,  the  analyst  Is  frequently 
required  to  make  judgments  of  changing 
significances  and  can  therefore  profit 
from  frequently  renewed  contacts  with 
clients,  in  particular  the  unit  com¬ 
mander. 

63.4  Knowledge  of  How  to  Get  More 
Information 

The  analyst  normally  works  as  part  of  a 
group  of  co-  located  analysts  who  share 
the  intelligence  production  workload  and 
operate  as  a  team-memory  resource  for 
one  another.  As  Indicated  by  Figure  6- 
1,  colleagues  are  the  most  immediate 
source  of  knowledge  after  the  internal 
memory  of  the  analyst  Is  exhausted.  In 
the  operation  of  several  intelligence 
fusion  groups  during  tactical  exercises. 
It  was  observed  that  specific  areas  of 
memory  responsibility  were  designated 
to  Individual  members  of  the  analytical 
team.  An  analyst  assigned  a  specific 
content  area  was  responsible  for  col¬ 
lecting,  reviewing,  end  remembering  or 
maintaining  availability  of  all  Information 
pertinent  to  that  area,  as  well  as  brief¬ 
ing  the  fusion  team  chief  when  neces¬ 
sary. 

Association  with  expe-ienced  analysts 
Is  the  major  source  for  gaining 
knowledge  of  where  to  find  Information 
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Analysts  develop  contacts  from  past 
assignments  or  training  courses  and 
retain  Informal  communication  with  those 
contacts.  Mission-defined  units  of 
Intelligence  organizations  are  not  large, 
and  analysts  with  wide  experience  are 
well  known  In  both  tactical  and  stra¬ 
tegic  settings. 

Most  analysts  supplement  personal 
memory  with  a  "shoebox"  of  specific 
references,  keys,  training  material,  etc., 
which  are  of  use  In  the  particular 
assignment.  There  Is  no  obvious  con¬ 
sistent  similarity  between  the  shoe- 
boxes  of  different  analysts. 

Computer  data  bases,  such  as  those  of 
the  DIAOLS/COINS  network  of  the 
Defense  Intelligence  Agency,  are  widely 
accessible  in  strategic  intelligence 
facilities  and  are  indirectly  accessible 
to  tactical  unite.  These  computer  data 
bases  greatly  extend  the  ability  of  the 
analyst  to  draw  on  previous  analytical 
work  and  archival  data. 

6.3.6  Knowledge  of  Collection  Capabil¬ 
ities 

Knowledge  of  collection  capabilities  is 
important  to  the  analyst  for  two  main 
reasons: 

1.  To  provide  judgmental  criteria 
regarding  strengths,  limitations,  and 
possible  artlfactual  aspects  of 
various  collection  meat  is,  and 

2,  To  provide  realistic  knowledge 
about  means  available  for  acquiring 
Information  unavailable  In  either 
Internal  or  external  memory. 

In  moat  production  situations,  analysts 
are  Isolated  from  the  functions  of  actu¬ 
ally  planning  collection  activities  and 
managing  collection  resources.  How¬ 
ever,  there  Is  a  growing  consensus  that 
the  generic  functions  of  intelligence 
production  and  collection  management 


can  be  performed  more  effectively  with 
somewhat  closer  coordination  between 
the  two  functions.  As  a  result,  it  is 
sometimes  found  advantageous  in  the 
tactical  environment  for  the  intelligence 
analyst  to  be  Involved  In  development 
of  the  collection  plan  at  the  early 
stages  of  deployment,  and  to  provide 
continuous  feedback  on  the  quality  of 
collected  data.  For  example,  a  SIGINT 
analyst  who  understands  the  limitations 
of  eL  jtronic  signal  detection  has  a 
better  perspective  on  the  reliability  of 
producing  regular  intelligence  products 
for  the  commander.  Similarly,  the  (MINT 
analyst  who  understands  the  problems 
of  the  reconnaissance  pilot  has  more 
accurate  expectations  of  the  complete¬ 
ness  and  accuracy  of  Imagery  missions. 

6.4  Personality  Attributes  of  the 
Ideal  Analyst 

The  attributes  of  the  Ideal  analyst 
offered  by  analysts  interviewed  during 
the  course  of  this  project  are  summar¬ 
ized  as  follows.  The  Ideal  analyst: 

e  Is  a  technologist. 

e  Is  focused  (either  a  specialist  or 
generalist,  not  both). 

e  Is  an  Information  entrepreneur  (as 
described  earlier). 

e  Is  comfortable  with  changing  roles 
as  apprentice,  peer,  trainer,  or 
consultant. 

e  Can  communlcr/ce  (written  and 
oral). 

•  Isa  detective. 

e  is  Imaginative. 

e  Is  setf-'startfng/self-organizing. 

e  Has  a  profession  (intelligence 
analysis). 
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•  Has  related  hobbles  or  technology 
Interests, 

e  Prefers  analysis  to  management. 

e  Can  perform  multiple,  concurrent 
activities. 

e  Is  Individualistic. 

e  Is  self-confident. 

e  Is  a  historian. 

<t  Has  a  photographic  memory. 

This  list  reflects  how  analysts  feel 
about  themselves.  Professionalism  is 
apparent  at  all  skill  levels.  The  most 
frequent  complaint  was  that  tactical 
unit  assignments  do  not  provide  an 
active  mission  or  an  adequate  access 
to  real  data  and  support  facilities  to 
maintain  and  extend  professional  skfllx 


e.  THE  COGNITIVE  MOOEL 
6.1  Overview 

The  cognitive  model  presented  here 
summarizes  selected  aspects  of  cogni¬ 
tive  functioning  that  appear  to  be  of 
central  Importance  to  the  processes 
Involved  In  Intelligence  analysis  activi¬ 
ties.  Each  aspect  ham  also  been  the 
object  of  laboratory  verification  In  the 
field  of  experimental  psychology. 

The  cognitive  model  is  an  abstract 
description  intended  to  summarize  and 
account  for  behavioral  and  psychologi¬ 
cal  observations  and  their  relationships. 
The  model  serves  to  describe  interre¬ 
lated  processes  that  occur  Inside  a 
person's  head  when  performing  Intelli¬ 
gence  analysis.  Cognitive  processing  Is 
a  continuum- -some  is  superficial  and 
some  very  deep.  During  superficial  pro¬ 
cessing  the  individual  is  sometimes 
aware  of  the  processing  and  sometimes 
not;  during  deep  processing  the  indivi¬ 
dual  Is  sometimes  aware  of  the  pro¬ 
cessing  and  sometimes  not.  Whether 
accomplished  within  or  outside  aware¬ 
ness,  cognitive  processing  is  a  dynamic 
Interplay  of  information  from  the  senses 
and  from  Internal  memory. 

The  cognitive  model  presented  here 
focuses  on  the  flow  of  information 
through  the  cognitive  "system", 
describes  Inputs  and  processes  operat¬ 
ing  on  those  Inputs  to  produce  outputs. 
The  inputs  may  come  from  the  external 
world  or  from  internal  memories.  The 
model  as  presented  does  not  account 
for  all  known  phenomena  or  describe  all 
known  processes  in  exhaustive  detail. 
It  does  provide  a  framework  for  under- 
atandlng  cognitive  processes  in  intelli¬ 
gence  analysis. 


The  cognitive  model  Is  summarized  by 
the  following  three  points: 

1.  An  Individual's  Initial  cognitive  pro¬ 
cessing  of  information  from  the 
environment  Is  conducted  within  a 
few  tenths  of  a  second  by  mechan¬ 
isms  operating  ou'nfde  the 
Individual's  awareness  (termed 
"automatic"  processing.)  As  dep¬ 
icted  In  Figure  6-1,  information 
enters  through  sense  organs  (eyes, 
ears,  etc.)  where  it  is  converted  to 
nerve  impulses  by  automatic  (out¬ 
side  awareness)  processes  and 
conducted  to  the  brain.  There,  an 
automatic  process  rapidly  compares 
the  raw  sonaory  information  with 
information  patterns  already  stored 
In  the  individual’s  memory.  This  is 
the  COMPARE  arrow  in  Figure  6-1. 

When  a  gross  match  Is  found,  parts 
of  the  raw  sensory  pattern  are 
automatically  s  elected  because  of 
their  similarity  to  features  of  the 
memory  pattern  and  are  combined 
with  other  elements  of  the  informa¬ 
tion  pattern  from  memory,  shown  in 
Figure  6-1  as  the  CONSTRUCT 
arrow.  The  resulting  pattern  of 
combined  Information,  still  outside 
awareness,  con&Jtutes  the  initial 
version  of  "meaning"  (of  a  visual 
scone,  of  a  pattern  of  sound,  of  a 
tactile  pattern,  etc.)  Thus,  all  initial 
meanings  represent  active  con¬ 
structions  performed  by  cognitive 
processing  mechanisms  operating 
outside  awareness.  As  already  indi¬ 
cated,  such  constructions  are  ordi¬ 
narily  accomplished  within  a  few 
tenths  of  a  second. 

2.  Many  initial  meanings  remain  out¬ 
side  awareness  and  trigger  pat¬ 
terns  of  highly  practiced  adjust¬ 
ments  that  are  also  carried  on  out¬ 
side  awareness.  Automatically 
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Figure  6-1 .  Cognitive  Mode!  Overview 


constructed  initial  meanings  form 
the  bases  for  generating  aware¬ 
ness  (when  swereness  occurs)  and 
for  the  initial  selective  focusing  of 
attention  on  certain  aspects  of  the 
aware  experience.  Such 

responses  include  automatically 
Ignoring  Information  as  Irrelevant, 
uninteresting,  or  completely 
expected. 

0.  The  central  cognitive  function  con¬ 
sists  of  a  continuous  cycling  of  the 
COMPARE/CONSTRUCT  process, 
with  each  cycle  accessing  the 
individual's  memory.  Each  cycle 
causes  some  modification  of  the 


memory-storage  structure  of  the 
particular  contents  accessed.  The 
modification  cf  memory  occurs 
regardless  of  whether  memory 
information  Is  used  only  for 
automatic  processing  outside 
awareness  or  is  used  also  for 
deeper  processing  at  progressively 
higher  levels  of  awareness  (such 
as  paying  close  attention,  studying 
a  situation,  thinking,  decision  mak¬ 
ing,  and  problem  solving.) 

Three  main  types  of  information 
modification  occur  as  products  of 
the  functioning  of  the  basic 
compare/construct  process: 
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•  sensory  Information  filtering, 

e  memory  information  consolida¬ 
tion, 

e  memory  access  Interference. 

Analysis  of  an  individual’s  experi¬ 
ences  In  terms  of  these  modifica¬ 
tion  mechanisms  can  provide  pred¬ 
ictions  about  cognitive  Information 
processing  behavior  to  be 
expected  from  that  individual. 
Thus,  although  individuals  have  lit¬ 
tle  conscious  control  over  the  func¬ 
tioning  of  their  memories  and  per¬ 
ceptions,  the  predictable  relation¬ 
ships  between  experience  patterns 
and  Information  modification 
mechanisms  can  be  used  to  predict 
and  control  the  functioning  of 
memory  and  perception. 

The  main  cognitive  functions  Just 
described  are  produced  by  basic,  ele¬ 
mental  processing  dynamics  operating 
through  a  structure  of  underlying  cogni¬ 
tive  capacities. 

To  summarize:  Human  cognition  may  be 
characterized  as  a  set  of  interrelated 
processes  which  operate  on  available 
information.  "Analysis"  Involves  the 
assignment  of  meaning  to  incoming  and 
previously  stored  Information.  The 
descriptive  model  of  analytic  behavior 
developed  here  builds  on  an  under¬ 
standing  of  some  of  these  basic  cogni¬ 
tive  processes  to  explain  analysts’ 
interpretation,  storage,  and  recall  of 
Information.  At  a  very  general  level  the 
model  describes  the  dynamic  interplay 
between  Incoming  information  and  previ¬ 
ously  stored  information  (i.e..  Internal 
memories).  Processes  which  are  cen¬ 
tral  to  this  Interplay  are  the 
COMPARE/CONSTRUCT  sequence  and 
the  memory  modification  cycle  involving 
filtering,  consolidation,  and  access.  At 
a  more  detailed  level  the  model 


describes  the  functioning  and  implica¬ 
tions  of  these  processes  and  underlying 
processing  dynamics. 

In  the  following  paragraphs,  memory 
modification  mechanisms  are  described 
first,  followed  by  an  account  of  the 
underlying  structure  of  cognitive  capa¬ 
cities  and  elemental  processing  dynam¬ 
ics. 

6.2  Information  Contents  Modification 
Cycle 

The  COMPARE/CONSTRUCT  processing 
of  information  depends  upon  elemental 
cognitive  processing  dynamics  (to  be 
described  later)  which  operate  continu¬ 
ously  during  wakefulness.  The  elemen¬ 
tal  dynamics  support  three  Information 
modification  mechanisms  that  operate 
on  the  sensory  and  memory  information 
used  by  the  compare/construct  pro¬ 
cess.  Since  Information  from  the 
senses  and  memory  constitutes  the  raw 
material  upon  which  intelligence 
analysis  Interpretations  and  estimates 
are  based,  the  Information  modification 
mechanjsms  have  important  implications 
for  understanding  and  predicting  the 
orientations  and  nature  of  analytic 
interpretations  and  estimates.  Figure 
6-2  diagrams  the  information  contents 
modification  cycle. 


8ensory  Information 


Memory  Access  yt _  Memory  Contents 

Interference  \ —  Consolidation 


Figure  6-2.  information  Contents 
Modification  Cycle. 
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The  cycle  Is  composed  of  three 
mechanisms:  sensory  Information  filter¬ 
ing.  memory  contents  consolidation,  and 
memory  access  Interference,  all  of 
which  are  described  below. 

6.2.7  Sensory  Inf  rmatlon  Filtering 

The  sensory  Information  filtering 
mechanism  Is  composed  of  two  comple¬ 
mentary  functions:  selectivity,  and 
generalization. 

0. 2.7.7  Selectivity  Filtering 

Selectivity  mechanisms  approach  filter¬ 
ing  from  the  viewpoint  of  answering  the 
question:  Which  aspects  of  the  raw 
sensory  information  pattern  are  signifi¬ 
cant?  The  compare/construct  process 
outlined  in  Section  6.1.1  compares  the 
raw  sensory  Input  for  similarity  with 
existing  memory  contents.  An  adequate 
gross  match  is  usually  found  quickly, 
and  the  sensory  Input  Is  relegated  to  an 
existing  gross  mental  category. 

Thus,  the  initial  compare/construct  pro¬ 
cess  often  ignores  (passively  rejects) 
significant  information  In  the  raw  sen¬ 
sory  Input  that  in  fact  does  not  fit  (at  a 
deeper,  more  detailed  level  of  analysis) 
the  mental  category  assigned  to  it.  If 
the  overall  first  Impression  of  the  sen¬ 
sory  Information  pattern  is  a  good  match 
with  gross  features  of  existing  memory 
contents,  disparities  between  the  sen¬ 
sory  pattern  and  the  memory  information 
pattern  at  more  detailed  levels  often 
have  no  chance  to  enter  awareness. 

Polarization  filtering  is  a  variation  of 
the  selectivity  filtering  mechanism,  In 
which  an  expectation  that  has  been 
established  usually  increases  the 
accessibility  of  memory  contents 
related  to  that  expectation  (l.e., 
memory  information  related  to  both  con¬ 
firming  and  denying  it).  This  produces  a 
polarization  effect  that  focuses  more 


attention  on  the  features  of  the  expec¬ 
tation,  thus  passively  rejecting  other 
potentially  Important  Information  that 
happens  to  be  Irrelevant  for  confirming 
or  denying  the  expectation. 

The  polarization  effect  can  bring  posi¬ 
tive  results  when  unfolding  events 
correspond  to  expectations  and  nega¬ 
tive  results  when  events  are  unrelated 
to  confirming  or  denying  expectations. 
Polarizing  effects  are  stronger  when  an 
expectation  Is  implicit  (l.e.,  Is  unexam- 
Ined  or  unquestioned  in  awa  eness). 
Explicit  questioning  of  expectations  can 
reduce  polarization. 

6.2. 7.2  Generalization  Filtering 

Generalization  mechanisms  approach 
filtering  from  the  viewpoint  of  answer¬ 
ing  the  question:  How  much  and  what 
kind  of  similarities  are  required  to 
recognize  things  as  the  same?  The 
confident  use  of  knowledge  depends  on 
being  able  to  generalize  from  experi¬ 
ence.  Success  In  applying  past  experi¬ 
ence  (memory  Information)  to  the 
present  depends  on  the  validity  of  gen¬ 
eralizations  employed  between  the  past 
and  the  present.  The  effective  use  of 
generalization  is  a  fundamental  and 
inescapable  aspect  of  dealing  success¬ 
fully  with  the  world.  The  elemental  pro¬ 
cessing  dynamics  and  basic  capacities 
of  the  cognitive  model  (to  be  described 
later)  provide  the  bases  for  identifying 
three  main  types  of  mechanisms  for 
filtering  by  generalization:  tolerance, 
analogy,  and  fill-in. 

6.2.7. 2.7  Tolerance  Generalization 

In  tolerance  generalization,  a  slot  In  a 
memory  storage  frame  (see  discussion 
accompanying  Figure  6-6)  is  filled  with 
new  raw  sensory  information  matching 
that  slot.  Generalization  can  occur 
depending  upon  the  tolerance  matching 
criteria  of  that  slot.  Since  memory  slots 
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are  organized  hierarchically  by  increas¬ 
ing  levels  of  detail  of  information  stored 
there,  tolerance  requirements  for 
matching  grow  more  stringent  at  the 
deeper,  more  detailed  levels  of  a 
memory  slot.  Of  course  generalization 
may  be  valid  or  Invalid  at  any  level,  but 
looser  tolerances  Increase  the  chance 
that  raw  sensory  Information  is  Inap¬ 
propriately  generalized. 

The  mechanism  of  tolerance  generaliza¬ 
tion  usually  operates  outside  aware¬ 
ness.  Deeper,  more  thorough  cognitive 
processing  that  Involves  more  time 
apent  in  highly  focused  aware  compari¬ 
son  between  sensory  information  and 
memory  Information  can  prevent  some  of 
the  errors  introduced  by  the  tolerance 
type  of  generalization. 

0.2.1. 2.2  Analogy  Generalization 

In  analogy  generalization,  comparisons 
of  similarity  are  made  between  the  pat¬ 
terns  of  relationships  connecting  the 
slots  of  different  memory  contents 
storage  frames.  For  example,  the 
memory  Information  about  very  different 
social  organizations  can  be  compared  In 
order  to  generate  analogies  between 
organizational  hierarchy  structures;  or 
memory  contents  depicting  the  relations 
between  pressure,  flow  volume,  and 
pipe  diameter  for  water  can  generate 
analogies  to  memory  contents  for  the 
relations  between  voltage,  amperage, 
?nd  r*  luctance  for  electricity.  The 
utility  jf  generalization  by  analogy 
depends  partly  upon  the  actual  rela¬ 
tional  equivalences  bet  /een  the  real- 
world  referents  for  the  analogy,  and 
partly  upon  the  validity  of  the  Infer¬ 
ences  drawn  on  the  basis  of  assumed 
relational  equivalences.  The  mechanism 
of  analogy  generalization  often 
operates  outside  awareness. 


0.2.1. 2.3  F Ill-In  Generalization 

In  f Ill-In  generalization,  missing  parts  of 
the  raw  sensory  pattern  are  filled  in 
from  similar  chunks  of  Information  in  the 
memory  frame  slot.  If  the  reasons  for 
missing  parts  of  a  sensory  information 
pattern  are  implicitly  understood, 
(either  because  they  are  obvious  or 
because  of  insufficient  consideration  of 
the  fact  of  missing  Information),  the 
flll-ln  Is  often  automatic.  The  results  of 
fill-in  are  advantageous  if  sufficiently 
correct  and  disadvantageous  If  based 
on  faulty  assumptions.  Careful  exami¬ 
nation  of  assumptions  about  missing 
data  can  raise  the  level  of  awareness 
used  In  flll-ln  processing. 

0.2.2  Memory  Contents  Consolidation 

Memory  contents,  including  information 
recently  passed  through  the  filtering 
process  and  stored,  are  consolidated 
(l.e.,  made  more  accessible  and  vivid) 
as  a  joint  function  of  the  frequency  of 
processing  and  the  amount  of  atten¬ 
tion  used  in  the  processing.  1  hus,  more 
frequently  encountered,  important 
types  of  experiences  upon  which  signi¬ 
ficant  mental  effort  are  expended 
be  some  more  vivid  and  immediately 
accessible  in  memory. 

The  increased  accessibility  and  vivid¬ 
ness  of  particular  memory  contents 
increases  the  likelihood  that  they  will 
be  used  as  filtering  criteria  In 
comparfng/constructfng  future,  some¬ 
what  similar  raw  experiences  (versus 
using  equally  appropriate  or  more 
appropriate  memory  contents  that  are 
less  accessible  and  less  vivid).  For  this 
reason  the  contents  consolidation 
mechanism  can  have  Important  Implica¬ 
tions  for  the  accuracy  of  analytic 
Interpretations  and  estimates. 

If  the  results  of  the  consolidation 
mechanism  match  the  realities  of  future 
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events  to  be  Interpreted,  the  effects  of 
consolidation  are  advantageous;  If  not, 
the  effects  are  a  disadvantage.  Long 
term  static  conditions  tend  to  Increase 
the  favorablllty  of  results  from  the  con¬ 
solidation  process,  while  eras  of  rapid 
and  significant  change  do  not. 

Hie  caricature  effect  Is  a  type  of  dis¬ 
tortion  that  can  result  from  the  process 
of  consolidation.  Mental  rehearsal  of  an 
experience,  rumination  about  an  experi¬ 
ence,  and  problem-solving  thinking 
about  at  experience  can  increase  the 
accessibility  and  the  vividness  of  the 
particular  memory  contents  related  to 
that  experience.  Given  no  additional 
external  Information  about  a  certain 
experience,  continued  rehearsal,  rumi¬ 
nation,  and  thought  tends  to  emphasize 
and  deemphaslze  various  aspects  of 
the  memory  of  that  experience. 

The  result  of  emphasis  and  deemphasis 
Is  to  "normalize"  usual  or  expected 
aspects  of  the  memory  and  to  exag¬ 
gerate  unusual  or  unexpected  aspects, 
with  usualness/unusualness  being 
Judged  In  relation  to  the  rest  of  the 
overall  memory  structure.  That  is,  the 
consistency  or  usualness  between 
some  of  the  contents  of  the  particular 
memory  am  the  balance  of  memory  con¬ 
tents  may  be  exagger  ted  beyond  their 
original  consistency,  and  the  disagree¬ 
ment  and  Inconsistency  In  other  parts 
of  that  particular  memory  may  also  be 
exaggerated  beyond  their  original  con¬ 
dition. 

Since  the  combined  results  of  these 
processes  tend  to  produce  a  memory 
that  Is  a  caricature  of  the  original  con¬ 
tents,  the  result  has  been  termed  the 
caricature  effect.  This  effect  tends  to 
feed  on  the  elements  of  unusualness 
and  surprise  and  to  overwelgh  these 
elements  as  compared  to  the  more 
expected  elements  of  experience.  If 


the  situation  is  such  that  novel  ele¬ 
ments  of  an  experience  are  accurate 
portents  of  a  future  aimllar  event,  the 
caricature  effect  may  provide  help  In 
interpretation  when  It  arrives.  If  not, 
ne  caricature  effect  can  be  an  Impedi¬ 
ment  to  accurate  Interpretation,  espe¬ 
cially  If  the  Interpretation  must  be 
based  on  Incomplete  data. 

The  caricature  effect  Is  a  special  "no 
new  information"  version  of  the  consoli¬ 
dation  mechanism  (the  latter  being 
based  on  repeated  instances  of  a  cer¬ 
tain  pattern  of  external  experience). 
Since  the  caricature  effect  depends 
partly  on  the  experience  of  initial 
surprise  followed  by  a  situation  favoring 
the  Intensive  use  of  unshared  and 
unexamlned  rehearsal  and  rumination, 
the  conditions  for  predicting  and  con¬ 
trolling  the  caricature  effect  are  at 
present  only  partially  understood. 

0.2.3  Memory  Access  Interference 

Memories  for  very  similar  experiences 
can  interfere  with  one  another  during 
memory  access,  slowing  access  and 
making  It  less  reliable  and  less  accu¬ 
rate.  (As  Indicated  in  the  diagram  of 
the  modification  cycle,  such  interfer¬ 
ence  can  have  strong  effects  on  the 
memory  Information  available  for  the 
filtering  stage  of  the  next  cycle.)  The 
two  main  Interference  effects  can  be 
termed  the  Intervening  similarities 
effect  and  the  similarities  saturation 
effect. 

6.2.3. 7  Intervening  Similarities 
Effect 

The  requirement  to  access  a  memory  of 
an  earlier  event  may  be  either  of  two 
types:  requirement  for  recall  or 
requirement  for  recognition. 

e  Recall  consists  of,  for  example, 
responding  to  the  question  "What 
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kinds  of  vehicles  were  present  in 
the  Imagery  you  viewed  before 
lunch  yesterday?"  That  is,  recall 
consists  of  accessing  memory 
contents  for  a  focus  of  attention 
of  an  earlier  experience,  based  on 
receiving  a  name  or  description  of 
the  situation  w'thln  which  that 
focus  of  attention  was  experi¬ 
enced 

e  Recognition  consists  of,  for  exam¬ 
ple,  responding  to  the  question  "Is 
this  frame  of  Imagery  one  of  those 
that  you  viewed  before  lunch  yes¬ 
terday?”  That  Is,  recognition  con¬ 
sists  of  accessing  a  memory  for  an 
earlier  situation  within  which 
currently  presented  specific  Infor¬ 
mation  was  experienced  as  the 
focus  of  attention. 

For  both  recall  and  recognition,  highly 
similar  experiences  that  have  Inter¬ 
vened  between  the  original  experience 
and  the  current  requirement  for  memory 
access  tend  to  Interfere  with  the 
accessibility  of  the  original  memory 
material;  the  Intervening  similarities 
effect  creates  interference  with 
memory  access  for  both  recall  and 
recognition.  Thus  an  analyst  processing 
many  messages  of  very  similar  contents 
from  the  same  domain,  under  constant 
conditions  an  1  over  an  extended  period 
of  time.  Is  unlikely  to  be  able  to  recall 
the  specific  messages  processed  dur¬ 
ing  a  certain  period  of  time.  Also,  the 
analyst  may  not  be  able  to  recognize  a 
specific  message  presented  for  re¬ 
examination  as  having  ever  been  pro¬ 
cessed. 

When  the  intervening  similarities  type 
of  memory  access  Interference  must  be 
circumvented  and  can  be  anticipated, 
recourse  to  external  memory  aids  is  the 
only  currently  effective  solution. 


B.2.3.2  Similarities  Saturation  Effect 

Concentrated  repetitions  of  highly  simi¬ 
lar  axparlancas  causa  proliferation  of 
many  highly  similar  memory  contents  In 
related  areas  of  memory.  The 
Increased  difficulty  of  comparing  across 
and  discriminating  between  many  similar 
memories  causes  reduced  speed  and 
accuracy  In  the  compare/construct  pro¬ 
cessing  of  each  new  related  experi¬ 
ence.  It  also  Interferes  with  rapid  and 
discrimlnable  storage  of  the  similar  new 
expt  lances  in  memory. 

The  similarities  saturation  effect  can  be 
lessened  by  providing  the  Individual  a 
chance  to  refocus  attention  on  dif¬ 
ferent  memory  contents  for  a  period  of 
timec  thus  allowing  the  Interfering 
memories  to  become  less  vivid  and  less 
Immediately  accessible.  When  the 
recovery  phase  has  been  accomplished, 
capacity  Is  again  available  to  learn  new 
discriminations  In  that  area  of  memory. 

The  intervening  similarities  and  similari¬ 
ties  saturation  forms,  of  interference 
with  memory  performance  are  predict¬ 
able  cognitive  mechanisms  of  informa¬ 
tion  processing.  They  operate  to 
weaken  and  diffuse  the  Information 
available  from  memory  by  affecting  the 
speed,  reliability,  and  accuracy  of 
access  to  memory  contents.  As  indi¬ 
cated  by  the  diagram  of  the  modifica¬ 
tion  cycle,  such  weakening  and  diffu¬ 
sion  can  change  the  pattern  of  memory 
contents  that  will  be  used  as  filtering 
criteria  for  the  next  cycle  of  experi¬ 
ence  and  memory  modification. 

To  summarize:  Memory  contents  sub¬ 
stantially  determine  the  individual’s 
automatic  responses  to,  as  well  as 
aware  experience  of,  new  information. 
At  the  same  time,  the  functioning  of 
memory  and  of  perception  Is  not  under 
the  direct  conscious  control  of  the 
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Individual.  Nevertheless,  three  poten¬ 
tially  predictable  and  controllable  cogni¬ 
tive  mechanisms  operate  In  a  cycle  to 
modify  Information  contents  available 
from  memory.  Since  memory  contents 
provide  a  large  portion  of  the  Informa¬ 
tion  used  In  making  many  Intelligence 
analysis  interpretations  and  estimates, 
the  information  contents  modification 
cycle  is  an  Important  concept  for  sug¬ 
gesting  ways  to  Improve  intelligence 
analysis. 

As  part  of  this  cycle  Information  is  fil¬ 
tered,  consolidated  and  otharwise  modi¬ 
fied.  Selective  filtering  may  operate  to 
Ignore  (filter  out)  aspects  of  Information 
that  are  disparate  from  stored  informa¬ 
tion.  Polarization,  stemming  from 
expectations  that  have  keen  esta¬ 
blished,  may  increase  the  chance  of 
processing  information  that  would  oth¬ 
erwise  have  been  filtered,  but  It  may 
also  lead  to  filtering  of  other  Information 
not  directly  related  to  confirmation  or 
denial  of  the  expectancy.  Generaliza¬ 
tion  Is  an  important  mechanism  which 
operates  during  the  filtering  process. 

Information  which  has  passed  from  the 
senses  through  the  filtering  process  is 
consolidated  with  preexisting  informa¬ 
tion  contents.  The  consolidation  pro¬ 
cess  provider  a  higher  degree  of 
access  to  information  frequently  called 
upon.  However,  it  also  may  lead  to 
various  distortions  of  the  information. 
Memory  access  Is  also  affected  by  the 
structure  of  memory  (the  relationship  c,f 
various  kinds  of  Information  in  storage). 
Attempts  to  recall  (remember)  informa¬ 
tion  frequently  encounter  interference 
resulting  from  unavoidable  confusion 
with  similar  information.  It  should  be 
noted  that  these  e  "facts  may  be  due  to 
distortion  during  tf  *,  Initial  storage  pro¬ 
cess  (the  Informal  jti  was  never  stored 
as  a  discriminate  Item)  or  during  the 


retrieval  process. 

6.3  Structure  of  Cognitive  Capacities 

The  structure  of  basic  cognitive  capa¬ 
cities  consists  of  Information  storage 
and  routing  facilities  and  their  relation¬ 
ships,  while  the  elemental  processing 
dynamics  consist  of  mechanisms  for 
transforming  Information  as  it  flows 
through  the  basic  structure.  From  left 
to  right,  the  column  headings  of  Figure 
6-3  depict  the  main  components  of  the 
cognitive  structure  and  their  relation¬ 
ship  to  the  analyst  environment  (the 
extended  work  setting): 

1.  Analytic  Work  Setting,  Including 
External  Memory 

,  2.  Analyst’s  Senses 

3.  Analyst’s  Sensory  Buffer 

4.  Analyst’s  Processor  Structures 
6.  Analyst’s  Internal  Memory 

Each  Is  described  briefly  below. 

» 

6.3.1  Analytic  Work  Setting  and  Extes 

nai  Metnory  \  \ 

Column  1  of  the  diagram  In  Figure  6-3 
depicts  the  work  setting,  which  con¬ 
tains  many  information  channels'  :*  hw 
kinds  shown  In  Figure  4-1.  Information 
may  be  available  through  media  au'uh  as 
face-to-face  or  telephone  converts- 
tions,  printed  materials,  computer  based 
displays,  etc. 

6.3.2  Senses 

Various  senses  (vision,  lieariSV^  touch,) 
In  column  2  are  the  means  by  Vihich  all 
Information  from  the  environing  t  enters 
the  cognition  of  the  analyst.  Each 
sense  type  can  be  distinguish  isc’  by  Its 
receptor  organ,  the  type  of  ey-Wlancs 
produced  by  the  sense,  the  type  of 
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physical  energy  to  which  the  sense 
organ  responds,  and  the  information- 
carrying  capacity  of  the  sense. 

0.3.3  Sensory  Buffer 

This  capability  (depicted  in  column  3) 
accepts  raw  information  from  the 
censes  and  makes  it  available  to  the 
rest  of  the  cognitive  structure,  while  at 
the  same  time  preserving  the  informa¬ 
tion  for  a  short  time  after  cessation  or 
change  In  the  sensory  input.  The  buffer 
has  several  characteristics: 

e  It  operates  like  a  "push-through" 
storet  New  information  from  the 
senses  replaces  or  forces  out 


older  information  after  a  certain 
(small)  accumulation  in  the  buffer 
has  been  reached. 

e  There  Is  partial  parallel  storage 
lor  different  senses:  Traces  for 
very  recent  auditory,  touch,  or 
muscular  senss  Inputs  outside 
awareness  and  attention  can  be 
recaptured  by  shifting  the  current 
focus  of  attention  from,  for  exam¬ 
ple,  the  visual  to  the  auditory. 
(The  reader  may  be  able  to  recap¬ 
ture  unnoticed  recent  sounds.) 

e  Storage  life  Is  very  limited:  From 
one-half  to  two  or  three  seconds 


f 


is  typical. 

•  It  may  ba  "commandeered" i  Large 
changes  In  stimulus  Intensity  for 
one  type  of  st'mulus  can  "swamp" 
the  buffer  capacity  and  momen¬ 
tarily  eliminate  the  traces  of  other 
types  of  stimuli  from  the  buffer. 

e  Buffer  contents  are  OUTSIDE 
awareness i  Buffer  contents  nor* 
mally  enter  awareness  only  after 
they  have  been 

compared/constructed  with  con¬ 
tents  from  memory  (l.e.,  are  made 
meaningful)  and  often  not  even 
then.  Thus,  the  focusing  of 
attention  (the  choice  of  which 
sensory  channel  and  material  to 
attend  to),  is  often  accomplished 
outside  of  awareness.  That  Is, 
tho  focusing  of  awareness  and 
attention  Is  accomplished  both  by 
processes  within  and  processes 
outside  of  awareness. 

63.4  The  Processor  Structures 

Column  4  of  Figure  0-3  contains 
COMPARE/CONSTRUCT  processes  which 
operate  to  transform  the  information 
flowing  from  the  sensory  buffer  to  the 
memory,  and  to  route  It  back  to  the  pro¬ 
cessors.  Three  processor  stn  aires 
are  shown.  The 

7.  Awareness  and  Attention  Processor 
generstes  awareness  and  attention 
for  Information  that  flows  through  It. 
Convarsrty,  all  Information  flowing 
outside  this  processor  Is  outs  Je 
the  Individual's  awareness  and 
attention,  and  thus  Is  processed  by 
•the: 

2.  Outside  Awareness  Processor  which 
has  a  larger  capacity  than  the 
awareness  and  attention  processor. 

3.  Executive  Actions  Processor  sup¬ 
ports  the  production  of  external 


behavior. 

These  three  processors  combine  their 
functions  to  produce: 

1.  External  behavior  within  individual's 

awareness. 

2.  External  behavior  outside 
Individual’s  awareness. 

3.  Internal,  unobservable  behavior 
within  Individual's  awareness. 

4.  Internal,  unobservable  behavior 
outside  individual's  awareness. 

6.3.5  Memory 

Column  6  represents  the  overall 
characteristics  of  human  memory  as  it  is 
usually  understood.  It  is  critical  to  an 
understanding  of  human  memory  and  of 
cognitive  processes  to  realize  that 
memory  and  thought  are  highly  struc¬ 
tured.  Without  categories  and  con¬ 
cepts,  an  Individual  would  be  unable  to 
deal  with  Incoming  and  stored  data.  A 
major  aspect  of  the  cognitive  model, 
then.  Is  the  structure  of  memory. 

e  There  Is  a  high  degree  of 
correspondence  between  the 
categories  of  information  available 
in  the  work  setting  and  the 
categories  of  Information  In 
memcry. 

e  For  each  category  of  analytic¬ 
relevant  Information  Contained  in 
storage  memory,  there  is  also 
corresponding  memory  Information 
Indicating  the  availability  (or  lack 
of)  supplementary  information  of 
the  same  category  In  the  work 
setting. 

e  The  accessibility  of  contents  of 
memory  varies  with  respect  to 
speed  of  access,  reliability  of 
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access,  and  level  of  detail  of 
Information  available.  The  overall 
dlmane Ion  of  aooaaalbillty  la  dep¬ 
leted  In  the  diagram  by  the  aoale 
shown  at  the  bottom  of  column  6. 
Highly  aooeeslble  contents  era 
depleted  as  "closer11  to  the  pro¬ 
cessor  structures  that  will  use 
them. 

e  Memory  contents  vary  with 
respect  to  the  amount  of  time 
they  have  been  In  storage. 
Although  storage  times  are  on  a 
continuum,  memory  researchers 
have  found  it  convenient  to  desig¬ 
nate  recently  stored  and/or 
recently  accessed  and  re-stored 
contents  as  being  In  "working”  or 
medium-term  memory.  Contents 
with  long  storage  lives  and  lass 
recent  accesses  and  re-storage 
are  designated  as  In  "long  term" 
memory. 

e  The  amount  of  information  poten¬ 
tially  available  from  long  term 
memory  Is  much  greater  than  In 
working  memory.  On  the  other 
hand,  as  Indicated  by  the  accessi¬ 
bility  scale  in  the  diagram,  the 
Information  in  working  memory  Is 
more  accessible  than  that  In  long 
term  memory. 

The  storage  structure  of  memory  Is  uni¬ 
form  across  its  working  and  long  term 
portions  and  across  all  categories  of 
contents.  The  structure  Is  built  up  from 
"chunks”  of  experience  that  are  fitted 
Into  the  "slots"  of  memory  "frame" 
structures,  as  follows: 

e  An  experience  is  organized  as  an 
Instance  of  a  type  of  something,  , 
occurring  within  an  Instance  of  a 
type  of  background  setting  (l.e., 
organized  as  Instances  of  "figure" 


and  "ground")*  for  example,  a 
truck  figure  In  a  camouflaged 
position  background  or  a  division 
figure  In  field  maneuvers  back¬ 
ground.  The  figure  and  the  ground 
oan  be  thought  of  as  two  gross 
"chunks"  Into  which  the  experi¬ 
ence  Is  divided.  Figure  and  ground 
chunks  ere  often  further  divided 
and  expanded  Into  chunks  at 
greater  levels  of  detail  (analogous 
to  the  effect  of  a  zoom  lens  in  the 
visual  realm). 

e  The  storage  structures  of  memory 
oorts  1st  of  frames,  each  composed 
of  a  pattern  of  slots  connected  by 
links.  Each  slot  represents  a  cer¬ 
tain  category  of  experience 
chunks  already  stored  in  memory 
and  Is  organized  hierarchically  by 
Increasing  level  of  detail  of  the 
experience  chunks  stored  In  it. 
The  examples  In  Figure  0-4  pro¬ 
vide  phrases  describing  informa¬ 
tion  category  chunks  stored  In 
memory  frame  slots,  with  progres¬ 
sively  more  detailed  chunks  at 
lower  levels  In  the  lists. 

e  A  link  In  a  memory  frame  Is  a  spe¬ 
cial  kind  of  slot  that  represents  a 
certain  type  of  relationship.  For 
example,  possible  relationships 
Unking  two  slots  designated  A  and 
B  would  be: 

A:  Is  part  of  B;  succeeds  B; 
occurs  with  B$  implies  B;  Is  a 
subclass  of  B;  Is  a  functional 
equivalent  of  B;  Is  synonymous 
with  B;  Implies  NOT  B;  was 
acquired  with  B;  is  associated 
with  B;  A  and  B  are:  ports  of  C; 
subclasses  of  C;  etc. 
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VISION 


HEARING 


Vehicle 

Tracked  vehicle 
Light  tank 
Topside 
Turret 
Turret  hatch 


Moving  vehicle  sounds 
Tracked  vehicle  sounds 
Particular  motor  sounds 
Particular  track  sounds 
Combined  Tank  sounds 
Sounds  of  Specific  Tank 


Figure  6-4.  Example:  Hierarchies  of  Information  Storage  Chunks 


Thus,  both  slots  and  links  are 
categories  of  experience  chunks 
already  stored  In  memory,  the 
categories  each  having  a  toler¬ 
ance  limit  for  accommodating  simi¬ 
lar  new  chunks  of  experience. 
Each  new  experience  Is 
represented  as  an  "Instance"  of 
the  category,  with  content  varia¬ 
tions  appropriately  appended. 

e  The  contents  of  memory  aro  out¬ 
side  awareness  until  they  are 
accessed  by  the  awareness  and 
attention  processor.  Ordinarily, 
when  being  accessed  by  the 
awareness  and  attention  proces¬ 
sor,  the  chunks  at  various  levels 
of  detail  In  a  memory  slot  are 
"opaque"  to  one  another;  i.e.,  two 
different  levels  of  detail  from 
memory  do  not  occupy  awareness 
simultaneously. 

Figure  6-6  diagrams  an  example  of  a 

memory  frame.  Each  of  the  two-way 


arrows  represents  a  link  between  a  pair 
of  flgura-ln-ground  slots.  While  all  pos¬ 
sible  relationships  between  slots  have 
been  depicted  In  the  diagram  example, 
many  potential  relationships  between 
slots  In  actual  memory  frames  may  be 
non-existent.  The  contents  of  slots  in 
the  example  were  selected  somewhat 
rrbitrorily  from  a  larger  set  of  possibili¬ 
ties,  to  help  shed  light  on  the  concept 
of  a  memory  frame,  ao  follows: 

Time  locale  slots  stores  a  time 
trace  organized  In  terms  of 
"before  and  after"  relationships 
between  chronological  anchoring 
points  for  significant  events,  and 
being  more  fine-grained  for  recent 
experience. 

(Sensory  slots  Often  contains  vague, 
general  chunks  for  sensory 
experiences  of  vision,  hearing, 
touch,  taste,  etc.;  this  is  espe¬ 
cially  true  in  cases  of  more 
abstract  experiences  Involving 


Figure  6-6.  Example  of  Memory  Frame  Structure 


information  communicated  via 
language  or  other  symbol**.  On  the 
other  hand,  the  memory  of,  for 
example,  a  personally  experi¬ 
enced  motorcycle  accident  may 
Include  vivid  sensory  chunks  In 
that  memory  storage  slot. 

Veluatlve/affectlve  sloti  Contains 
chunks  representing  value  conno¬ 
tations  such  as  goodness  or  bad- 
nass,  strength  or  weakness,  and 
dynamic  or  static,  as  well  as  emo¬ 
tions  such  as  affection,  anger,  or 
fear. 


Linguistic  categories/ relations 
sloti  Contains  chunks  representing 
tingulstic/semantic  descriptive 
categories  and  relations.  Experi¬ 
ences  originally  conveyed  vis 
language  and  other  symbols,  and 
experiences  that  the  Individual 
has  talked  or  written  about,  are 
more  likely  to  have  vivid  material 
readily  accessible  in  this  slot. 

Process  pattern  sloti  Contains 
chunks  representing  "ptocesa 
phenomena1'  In  which  the  particu¬ 
lar  linked  Instance  of  experience 
Is  understood  as  one  step  or 
stage  of  a  larger,  time-distributed 
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process  not  directly  experienced 
In  the  situation.  The  chunks  in 
process  pattern  slots  are  a  main 
source  of  expectations. 

Behavior  production  slots  often 
contains  little  or  no  material.  In 
Instances  where  a  type  of  experi¬ 
ence  demands  external  behavior, 
a  chunk  residing  in  this  slot  pro¬ 
vides  the  outlines  of  "plans"  for 
producing  the  required  behavior. 

Memory  frames  are  the  basic  building 
blocks  for  higher-order  storage  struc¬ 
tures  of  memory: 

e  A  frame  may  operate  as  a  slot  in 
another  frame. 

e  Superframes  (systems  of  frames) 
develop,  which  systematise  the 
storage  of  experience  In  terms  of 
consistencies  based  on  similarities 
between  frames  as  well  aa  other 
types  of  relationships  between 
them. 

To  summarize:  Raw  Information  from  the 
aense  organs  flows  through  the  sensory 
buffer  where  It  Is  retained  only  long 
enough  to  be  accepted  by  the 
COMPARE/CONSTRUCT  processes,  Initial 
phases  of  which  operate  outside 
awareness.  These  processes  rapidly 
end  automatically  COMPARE  the  Infor¬ 
mation  input  with  patterns  of  information 
already  stored  In  memory,  and  CON¬ 
STRUCT  a  meaning  (a  response)  from  a 
combination  of  the  Input  and  memory 
information.  The  Initial  construction  of 
meaning  takes  place  outside  awareness 
within  tenths  of  a  second.  The  meaning 
may  then  be  used  to  elicit  actions,  it 
may  obtrude  Into  awareness  and  drive 
thought  processes,  It  may  remain  out¬ 
side  awareness  and  result  In  automatic 
adjustive  reactions,  or  any  combination 
of  these.  ‘ 


Memory  may  be  conveniently  divided 
Into  a  "working"  memory,  which  stores 
current  information  for  short  durations, 
and  "long-term"  memory.  Information  In 
both  parts  of  memory  Is  stored  in  pat¬ 
terns  called  frames,  which  consist  of 
skits,  nodes,  or  chunks  connected  by 
links.  The  Information  in  slots  Is 
arranged  hierarchically  by  level  of 
detail  and  specificity.  The  information  in 
links  represents  types  of  relationships 
that  hold  between  the  information  con¬ 
tained  in  the  slots.  A  frame  may 
comprise  a  slot  In  a  larger,  more  incor- 
porative  framo,  thus  allowing  for  very 
complex  memory  structures  to  e 
developed. 

5.4  Elemental  Dynamic  Processes 

A  brain  trace  representing  an  experi¬ 
ence  chunk  exists  In  the  form  of  a 
neural  code;  colors  and  sounds  them¬ 
selves  do  not  exist  In  the  brain  but  are 
represented  there  neurochemically. 
When  stored  !;n  memory,  the  Information 
represented  by  such  a  code  is  dormant. 
When  a  trace  representing  a  chunk  in 
memory  Is  activated  and  the  information 
represented  by  tho  trace  is  used  in 
processing,  the  action  is  referred  to  as 
decoding  the  memory  trace.  Con¬ 
versely,  when  an  Itistance  cl  an  experi¬ 
ence  chunk  le  stored  in  memory  in  the 
form  of  Inactive  brain  traces  the  action 
is  referred  to  as  encoding  the  experi¬ 
ence.  Matching  is  comparing  trace 
codes  for  similarity.  A  match  Is  an 
identified  similarity  betwoen  codes. 

The  basic  compare/construct  process 
described  earlier  (see  Figure  S-3)  is 
made  up  of  more  elemental  dynamic 
processes  consisting  of  a  behavioral 
sequence  o.  matching,  Jocoding, 
matching,  and  encoding  steps  (MDME 
for  Match  Decode  Match  Encode).  The 
MDME  processes  eperate  on  the  infor¬ 
mation  flowing  from  the  sensory  buffer 


-  0-14  - 


1  rcyrwism 


' -rf^n  H';  V >... 

I 


to  the  memory  and  back  to  the  proces¬ 
sor  structures.  In  brief,  In  the  MDME 
sequence,  sensory  information  In  the 
form  of  neural  impulses  Is: 

1.  matched  grossly  against  memory 
Information.  The  memory  Informa¬ 
tion  activated  as  grossly  similar  Is 
then 

2.  decoded  to  a  depth  sufficient  to 
ensure  the  degree  cf  secondary 
match  necessary  in  the  particular 
situation.  This  compare/construct 
process  produces  a  new  configur¬ 
ing  or  "chunking"  of  Information, 
which  is 

3.  encoded  in  the  form  of  new  pas¬ 
sive  brain  traces. 

4.  The  newly  constructed  chunk  of 
Information  also  flows  to  other 
parts  of  thi  cognitive  structure  in 
the  fcrm  of  a  Decoded  Memory 
Return  (DMR).  The  DMR  may  flow 
to  the  awareness  and  attention 
processor  where  It  may  program 
external  behavior  within  awareness 
and/or  match  end  decode  other 
memory  contents,  including  aware¬ 
ness  of  "no  significant  change." 
The  awareness  processor  has  a 
limited  information  processing  capa¬ 
city,  and  can  focus  close  attention 
on  only  one  level  of  detail  of  an 
experience  at  a  time. 

6.  Ir  thought  and  problem  solving,  the 
DMR  often  originates  in  cognitive 
activities  stimulated  by  memory 
contents  rather  than  by  Information 
from  the  sensory  huffer. 

6.  The  DMR  may  also  flow  to  the  exe¬ 
cutive  actions  processor,  where  ft 
operates,  In  coordination  with  other 
behavioral  plans  information  from 
memory,  to  program  patterns  of 
external  behavior.  The  executive 


actions  processor  may  operate  in 
conjunction  with  the  awareness 
and  attention  processor  to  produce 
aware,  deliberate  forma  of  external 
behavior.  More  commonly,  however, 
tha  executive  actions  processor 
operates  outside  awareness  to 
produce  automatic  external 
behavior  In  response  to  DMRs 

7.  Under  special  coodltlona,  raw  infor¬ 
mation  from  the  sensory  buffer  may 
momentarily  force  Its  way  into 
awareness  before  being  processed 
through  memory  by  the  MDME 
processes.  As  a  result,  there  is 
momentarily  no  DMR,  and  the  raw 
sensory  Information  is  therefore 
experienced  as  meaningless. 

To  summarize  the  MDME  processes; 
Several  points  for  application  to  discus¬ 
sions  in  the  chapter  following  can  be 
drawn: 

e  The  awareness/ettention  proces¬ 
sor  has  a  limited  capacity  com¬ 
pared  to  MDME  processes  operat¬ 
ing  outside  awareness. 

e  All  information  in  normal  awareness 
has  been  filtered  and  filled  In  from 
memory  contents  by  processes 
usually  outside  awareness. 

e  Sensory  data  from  the  external 
world  has  no  maanlng  unless  fil¬ 
tered  and  filled  in  from  memory 
contents  by  processes  operating 
initially  outside  the  Individual's 
awareness. 

e  Factors  that  form  end  control  sen¬ 
sory  perceptions  and  attention  are 
mostly  outside  the  individual's 
control.  This  is  also  true  of 
remembering  and  thinking;  indivi¬ 
duals  cannot  force  their  thought  to 
contain  exactly  the  desired  con¬ 
tents. 


To  summarize  the  cognitive  model: 
Memory  contents  substantially  deter¬ 
mine  the  individual's  automatic 
responses  to,  as  weil  as  aware  experi¬ 
ence  tf,  new  information.  At  the  same 
time,  the  functioning  of  memory  and  of 
perception  is  not  under  the  direct  cons¬ 
cious  control  of  the  individual. 
Nevertheless,  three  potentially  predict¬ 
able  and  controllable  cognitive  mechan¬ 
isms  operate  in  a  cycle  to  modify  Infor¬ 
mation  contents  available  from  memory. 
Since  memory  contents  provide  a  large 
portion  of  the  information  used  In  making 
many  Intelligence  analysis  Interpreta¬ 
tions  and  estimates,  the  Information 
contents  modification  cycle  is  an  impor¬ 
tant  concept  for  suggesting  ways  to 
Improve  Intelligence  analysis. 

Memory  contents  are  stored  hierarchi¬ 
cally  by  level  of  detail,  with  gross 
features  and  outlines  a*  Information  at 
shallower,  more  accessible  levels  of 
storage,  and  fine  details  at  deeper  lev¬ 
els.  A  central  compare/construct 
mechanism  matches  Incoming  raw  sen¬ 
sory  Inputs  to  similar  memory  contents 
and  actively  constructs  a  composite 
return  which  drives  behavior  and 
experience.  Hie  compare/construct 
mechanism  also  matches  inputs  from 
one  part  of  memory  with  those  from 
another,  thus  allowing  thought  and  prob¬ 
lem  solving  without  external  stimuli. 
The  basic  memory  storage  frame  struc¬ 
ture  composed  of  slots  and  links  allows 
for  very  flexible,  complex  storage 
stnictures  comprising  super-frames  and 
memory  systems.  The  strategies  and 
Judgmental  criteria  used  by  the  action 
executive  processor  and  the  aware¬ 
ness  and  attention  processor  are  them- 
slves  composed  of  contents  from  com¬ 
plex  memory  structures. 
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7.  THE  COGNITIVE  MODEL  IN  THE  ANA¬ 
LYTIC  WORK  SETTING 

This  Motion  reviews  the  results  of  sur¬ 
veying  the  analytic  work  setttnga  In  tha 
light  of  tha  cognitive  modal  just 
presented. 

7.1  Special  Importance  of  Memory 

A  main  theme  of  the  cognitive  model  la 
that.  In  normal  psychological  functioning 
In  everyday  environments  with  "Ideal1* 
outside  Information,  the  balance  of 
Information  used  from  memory  and 
received  from  the  outside  favors 
t  .,«h*o*y  much  more  than  casual  obser¬ 
vation  would  lead  one  to  suspect.  In 
many  kinds  of  Intelligence  analysis,  this 
balance  Is  tipped  even  further  toward 
use  of  memory  by  the  conditions  of 
these  environments;  analysts  rarely 
have  what  they  would  view  as  Ideal 
data  coverage  of  the  objects  of  their 
Interpretations. 

Often  information  from  memory  provides 
the  sole  basis  for  hypothesizing  rela¬ 
tionships  among  data  available  for 
Interpretation  and  for  classifying  vari¬ 
ous  data  as  relevant,  redundant, 
present,  absent,  or  crucial  for  the  Inter¬ 
pretive  task.  Highly  confident  classifi¬ 
cations  of  data  value  can  be  made  only 
In  hindsight,  since  it  is  the  unique 
nature  of  the  object  or  event  inter¬ 
preted  that  finally  determines  such 
classifications.  Information  models, 
(models  couched  in  information  descrip¬ 
tive  terms,  and  derived  from  the  more 
general  conceptual  models  defined 
earlier)  provide  some  aids  for  classify¬ 
ing  available  data  prior  to  actual 
interpretation,  but  at  best  serve  merely 
as  guidelines,  and  sometimes  even  mis¬ 
guide  analysis.  The  analyst  Is  left  with 
the  on-the-spot  task  of  dynamically 
classifying  much  of  the  data  presented 
for  Interpretation. 


7.2  Awareness  of  Memory  Function 

Often  we  are  not  aware  that  information 
we  are  using  la  coming  from  memory. 
Memory  Information  used  at  even  high 
levels  of  awareness  does  not  neces¬ 
sarily  obtrude  Into  awareness  labeled 
as  "Information  from  memory."  Figure 
7-1  provides  a  simple  Illustration  of  this 
phanomenon  In  an  example  of  contribu¬ 
tions  of  memory  to  the  task  of  Identify¬ 
ing  a  military  vehicle  masked  by  a  tree. 
Visible  parts  of  the  vehicle  provide  the 
cues  for  matching  and  decoding  memory 
contents  and  reconstructing  the  visu¬ 
ally  missing  parts  of  the  vehicle.  As  the 
flll-ln  is  accomplished,  the  image  of  the 
tree  Is  effectively  dimmed  or  even 
erased  from  consideration.  At  this  point 
the  tree  is  down-graded  or  eliminated 
from  awareness,  and  a  "camouflaged 
tank  retriever"  is  confidently  reported. 
The  fact  of  using  information  from 
memory  for  flll-ln  is  usually  dismissed  or 
not  even  noticed.  The  same  sequence 
of  data  occlusion,  fill-in,  and  dispensing 
with  the  fact  of  occlusion  and  fill-in 
occurs  continuously  for  conceptually 
more  complex  and  subtle  forms  of 
experience  associated  with  analysis. 

7.3  Memory  Aids  and  Memory  Load 

The  Information  resources  and  variables 
In  analytic  work  settings  are  usually 
quite  complex  (see  Figure  4-1).  The 
loads  Imposed  on  Internal  memory  are 
lessened  by  external  memory  aids  such 
as  maps,  reference  materials,  and  com¬ 
puter  displays.  Such  external  aids 
have  advantages.  The  externalized 
information  models  they  contain  (tem¬ 
plates,  doctrine,  IPB,  etc.)  usually 
suffer  less  from  memory  modification 
and  Judgmental  distortion  factors  than 
models  stored  in  the  analyst’s  cognitive 
memory.  Cur  ntly,  however,  such 
materials  ary  costly  to  produce, 
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Figure  7-1 .  Example  of  Occlusion  and  FlIMn 


slow  to  update  compared  with  the 
analyst’s  Internal  storage  memory,  and 
usually  provide  only  a  partial  match  with 
the  realities  toward  which  they  are 
aimed. 

Apart  from  the  potential  analytic  value 
of  memory-aid  materials,  their  proper 
handling  and  use  oan  pose  memory 
problems  for  the  analyst.  Passive  ver¬ 
sions  of  such  supports,  which  must  bo 
remen. oered  and  searched  out  to  be  of 
use,  can  tax  an  analyst's  memory  In 
locating  materials.  Active  versions  of 
such  supports  (such  as  alarms,  forced 
displays,  flashing  prompts,  rigid  rem¬ 
inder  schedules,  etc.!  create 


Interruptions,  distractions,  and  pro¬ 
cedural  overload,  by  diverting  the 
analyst's  limited-capacity  awareness 
and  attention  processor.  This  is  more 
likely  when  It  Is  being  used  for  deep 
processing  of  extensive  stored  Inter¬ 
mediate  results  (problem-solving 
thought). 

7.4  Decision  Pressure 

Analysts  must  us»  part  of  their- memory 
an  I  processing  capacity  resources  to 
pl£<n  and  manage  their  own  work 
behavior.  Knowledge  about  work  plan¬ 
ning  and  management  Is  also  part  of  the 
analyst's  Internal  isemory  resources, 


which  Imposes  memory  load  whan  uaad. 
Tha  analyst  must  uaa  available 
raaouroaa  of  time  rnd  Information  wisely 
to  obtain  tha  bast  Interpretations  and 
estimates  possible  under  given  clr- 
oumstanoes.  No  static  formula  Is  avail¬ 
able  for  planning  the  proper  use  of 
resources  In  each  new  situation;  many 
considerations  for  intelligence  analysis 
are  unique  to  each  situation,  and  deci¬ 
sion  making  about  related  cognitive 
Information  processing  activities  must 
accordingly  be  dynamic. 

Most  centrally,  the  analyst  must 
repeatedly  decide  when  the  point  has 
been  reached  where  the  results  of 
each  analytic  endeavr.  or  n  ■'e  fficiently 
clear  to  warrant  no  r\.rth«>  expenditure 
of  analytic  resources  ur."h>-  the  current 
conditions  of  -^source  availability. 
Situation r-'  varie  ties  that  focus  pres¬ 
sure  on  such  decisions  Include: 

e  Amount  of  ambiguity  and  uncer¬ 
tainty  In  the  data  and  In  memory. 

e  Possible  losses  or  penalties  asso¬ 
ciated  with  a  serious  error  of 
interpretation. 

e  Amount  of  error  reduction  possible 
If  more  data  and  analytic 
resources  could  be  applied  to  the 
Interpretation. 

e  Limitations  on  applying  more  ana¬ 
lytic  resources.  Including  time,  to 
the  Interpretation. 

Analytic  situations  Involving  great  ambi¬ 
guity,  large  possible  penalties  from 
error,  great  potential  for  error  reduction 
with  more  processing,  but  severe  limits 
on  more  processing  can  cause  great 
docialon  pressure.  Under  such  cir¬ 
cumstances,  typical  decision  behaviors 
Include: 

e  Fixation  on  Isolated  aspects  of  the 
situation  rather  than  a  balanced 


attention  to  all  parts. 

e  Excessive  osculation  In  choosing  a 
final  Interpretation. 

s  Lowered  predictability  and  orderli¬ 
ness  in  final  interpretive  choices 
("leaps11  rather  than  logical 
steps). 

Certain  arrangements  an  procedures 
observed  In  analytic  work  settings  can 
function  to  forestall  decision  pressure, 
to  Insulate  the  analyst  from  it,  or  to 
constrain  behavior  under  pressure. 
These  Include: 

e  Step  by  stop  task  guidelines  for 
data-handling. 

e  Checklists  and  templates  to  help 
channel  thinking. 

e  Allocation  of  resources  and  task¬ 
ing  Instructions  provided  by 
management. 

e  Discussion  and  exercises  con¬ 
cerned  with: 

—  The  recognition  of  decision 
pressures  In  a  situation. 

—  The  techniques  for  redistribut¬ 
ing  analytic  load,  If  that  can 
help. 

—  The  uses  of  accountability  pro¬ 
cedures  as  checks. 

—  The  uses  of  consulting  and 
consensus  among  colleagues. 

Of  course,  each  of  the  items  listed 
above  also  serves  other  purposes 
besides  lessening  the  effects  of 
decision  pressure.  Decision  pres¬ 
sure  as  a  phenomenon  la  recog¬ 
nized  with  different  degrees  of 
explicitness  in  different  work  set¬ 
tings,  but  the  problem  of  lessening 
the  pressure  Is  rarefy  approached 
on  an  explicit  systematic  basis. 
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7.6  Memory  Resource  Management 

Concerns  of  management  and  analytic 
personnel  about  the  management  of 
memory  resources  are  reflected  In  many 
field  activities: 

a  Controlling  analyst’s  expectations 
about  the  moet  likely  meanings  of 
forthcoming  data. 

a  Assigning  analysts  limited  needs  to 
know  that  are  not  related  to  secu¬ 
rity  requirements. 

a  Planning  and  maintaining  coverage 
arid  backup  for  team  members’ 
currant  knowledge  and  skills. 

a  Planning  and  maintaining  feedback 
on  accuracy  of  analytic  perfor¬ 
mances. 

a  Improving  the  quality  and  availabil¬ 
ity  of  external  memory  supports 
and  aids. 

Although  the  Importance  and  impact  of 
the  reliability  and  quality  of  memory 
functions  (versus  the  reliability  and 
quality  of  data)  Is  occasionally 
remarked,  the  magnitude  of  this  impor¬ 
tance  as  shown  by  the  cognitive  model 
Is  usually  less  clearly  grasped. 

7.0  Team  Memory 

An  external  memory  resource  widely 
used  by  analysts— especially  under  try¬ 
ing  circumstances— is  the  "team 
memory11  represented  by  colleagues. 
Colleagues  have  advantages  as  exter¬ 
nal  memory  supports  because: 

e  query  formulation  Is  compara¬ 
tively  easy;  a  colleague  can  not 
only  provide  Information,  but  can 
help  the  analyst  define  a  need 
and  frame  a  query  In  terms  under¬ 
standable  to  the  colleague. 

e  rapid  response  Is  available;  a  col¬ 
league  can  quickly  indicate 


whether  or  not  any  help  can  be 
expected.  This  allows  the  analyst 
to  search  widely  In  a  short  time  if 
necessary. 

e  rapid  update  of  polleagues’ 
memory  contents  can  be  achieved 
under  some  conditions  for  which 
materlals-based  memory  support 
systems  may  require  considerably 
more  time  for  update. 

e  self  correction  of  external 
memory  resources  is  somewhat 
automatic  since  colleagues  tend  to 
recognize  their  memory  shortcom¬ 
ings  and  try  to  correct  them. 
Materlals-based  memory  support 
systems  could.  In  principle,  be 
designed  this  way,  but  such  sys¬ 
tems  are  not  likely  to  be  realized 
In  the  near  future. 

e  active  problem  solving  by  col¬ 
leagues  Is  frequently  included  as 
part  of  the  team-memory  services 
to  one  another;  relevant  memory 
contents  are  not  only  located  and 
communicated,  but  also  compared, 
placed  in  contexts,  evaluated,  and 
conclusions  are  drawn. 

Colleagues  can  be  disadvantageous  as 
external  memory  supports  because: 

e  disruption  of  colleague  tasks  Is 
often  an  inescapable  result  of 
using  team-distributed  memory. 
The  availability  of  team- 
distributed  memory  cannot  be 
guaranteed  under  conditions  of 
nigh  organizational  work  load, 
unless  extra  personnel  have  been 
planned  for  such  functions. 
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Figure  7- 2.  Examples  of  Shared  (Equivocal)  Data  Patterns 


7.0.7  Disparity  Analysis  A  necessary 
part  of  the  team  memory  approach  is 
the  analysis  of  disparities  between 
Interpretations  supplied  by  Individuals 
with  different  backgrounds  and 
viewpoints.  Objective  "ground  truth" 
about  real  world  situations  (as  distinct 
from  exercise  or  laboratory  situations) 
Is  rarely  available,  even  historically,  and 
never  (Hiring  the  actual  task  of 
Interpretation.  Therefore  the  analysis 
of  disparities  between  different 
Interpretations  remains  a  fundamental 
technique  for  evaluating  Interpretations 
Although  comparisons  among  different 
Interpretatime  la  usually  the  only 


means  available  for  checking  the 
soundness  of  Interpretations,  disparities 
among  different  Individuals'  interpreta¬ 
tions  of  the  same  data  result  from 
differences  In  memory  contents, 

The  presence  of  equivocal  data  Is  most 
often  the  condition  that  prompts  dif¬ 
ferent  IndVIdiwIs  to  produce  disparate 
Interpretations.  This  point  Is  Illustrated 
by  Figure  7-2.  The  top  two  ovals  In  the 
figure  show  that  a  tank  and  a  heavy 
truck  have  certain  shared  attributes  (at 
the  visual,  auditory,  and  ground  sensor 
levels).  If  only  these  shared  attributes 
are  available  m  the  data  to  be  inter¬ 
preted,  the  data  are  equivocal 
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regarding  tanka  and  trucks.  In  that 
cast,  either  interpretation  can  be  made, 
end  the  interpretation  produced  will  be 
controlled  by  the  analyst’s  current  pat¬ 
tern  of  accessible  memory  contents. 
The  figure  also  depicts  the  same 
phenomenon  applying  to  Information 
about  larger,  more  complex  realities. 

7.7  System  Aggregation  Models  for 
Data  and  Concepts 

Belated  to  the  team  functioning  con¬ 
cept,  but  distributed  over  a  wider  sys¬ 
tem  domain,  are  the  continuing  change- 
induced  tasks  of  reapportioning  func¬ 
tions  for  aggregating  data  and  concepts 
at  various  polntu  In  the  system.  Data 
selection,  aggregation,  and  conceptuali¬ 
zation  practices  within  an  analytic  work 
setting  are  developed  on  the  basis  of 
currant  factors  such  as  technical  skills, 
levels  of  correlation  and  fusion  func¬ 
tions,  standing  uses  for  the  interpretive 
products  (targeting,  ENSIT,  IPB,  plan¬ 
ning,  operations,  etc.),  and  special, 
client-targeted.  Information  packaging 
requirements.  These  arrangements 
develop  out  of  the  necessity  of  the 
division  of  work  within  the  system  and 
reflect  experience  with  requirements, 
conditions,  and  capabilities  at  various 
places  In  the  organizational  network. 

The  resulting  patterns  of  memory  usage 
and  modification  in  each  type  of  work 
setting  create  systems  of  memory 
frames  (superframes)  that  constitute  a 
typical  "view  of  the  world"  from  the 
vantage  point  of  that  setting.  Indica¬ 
tions  rf  such  different  views  appear  In 
answers  to  such  questions  as:  How  do 
you  perceive  most  data  (eyes,  ears, 
etc.)?  What  kinds  of  mental  Images  do 
you  use  In  your  work?  How  many  dif¬ 
ferent  pieces  of  information  must  you 
typically  bring  together  to  make  your 
Interpretation?  Typically,  how  many 
alternative  Interpretations  for  the  date 


will  you  entertain  mer.ially.  How  large 
a  geographical  ares  will  typically  be 
occupied  by  a  phenomenon  to  be  Inter¬ 
preted  by  you?  What  is  an  average 
span  of  time  over  which  an  Interpreta¬ 
tion  made  by  you  can  be  expected  to 
remain  in  correspondence  with  the 
real-wcrld  objects  or  events?  Such 
specialized  viewpoints  are  an  Integral 
part  of  the  efficient  performance  of 
analytical  work  In  the  various  settings. 

The  necessarily  different  work-oriented 
world  views  of  different  settings  can 
create  Interferences  In  Information 
passing  between  settings  and  can  com¬ 
pound  problems  of  analyzing  the  dispari¬ 
ties  between  Interpretations  from  dif¬ 
ferent  settings.  One  manifestation  of 
this  Is  the  desire,  at  lower  levels  of  the 
system,  to  see  the  big  picture  and,  at 
higher  levels,  to  evaluate  the  raw  data. 
Information  models  In  higher-level 
analyst’s  memories  (sometimes  made 
explicit  In  material  form)  occasionally 
contain  references  to  different 
vlawpoints  experienced  In  different 
work  sottings.  Nevertheless,  there  are 
as  yet  many  unexplored  relationships 
between  arrangements  for  aggregating 
data  and  concepts,  and  the  use  of 
explicit  information  models. 
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8.  IMPLICATIONS  OF  FINDINGS 

No  claim  la  mada  that  all  of  tha  Implica¬ 
tion*  of  thla  study’*  findings  hava  baan 
noted.  Nona  of  tha  Implication*  found 
hava  baan  avakiatad  In  tha  praaant 
projact,  since  such  evaluation  should  bo 
pramlaad  on  tha  auocoaaful  validation 
of  tha  cognitive  modal  of  analytic 
aotlvltias.  Implications  that  suggested 
thamsalvas  to  tha  projact  tsam  a ra 
presented  primarily  as  questions  for 
which  answers  might  be  found  either 
within  existing  organizational  expertise 
or  by  new  Investigations.  Soma  possi¬ 
ble  Implications  for  a  number  of  areas  of 
management  concern  ara  discussed  In 
tha  following  paragraphs: 

8,1  Analytic  Accuracy 

Tha  strongest  Implication  of  tha  study 
findings  Is  Judged  to  be  the  possible 
leverages  for  improving  analytic  accu¬ 
racy  that  might  be  gained  by  studying 
memory  modification  cycles  In  the  indi¬ 
vidual  and  team  contexts  of  analytic 
work  settings.  The  fundamental  goal 
toward  which  all  efforts  at  improving 
intelligence  analysis  are  finally  aimed  Is 
Improving  the  accuracy  and  quality  of 
Interpretive  products.  Improvements 
can  result  from  factors  such  as  pro¬ 
gress  In  management  philosophies  and 
techniques,  advanced  systems  for  sup¬ 
port  of  analyst's  memory  requirements 
and  for  complex  judgmental  tasks, 
Improved  arrangements  for  performance 
feedback,  more  accurately  directed 
training,  Improved  selection  and  career 
management,  and  better  data  to  Inter¬ 
pret.  Underlying  all  such  Improvements 
will  still  be  the  Indispensable  high-grade 
performance  of  the  analyst’s  memory, 
and  governing  the  performance  of  the 
analyst's  memory  will  be  the  memory 
modification  cycle  depicted  In  the 
model. 


It  should  be  poesible  to  determine  to 
what  extent  efforts  to  develop  aids  to 
memory  suggested  by  the  model,  such 
a*  examining  expectations,  performing 
deeper  processing,  sharing  rehearsal 
experlenoea,  reviewing  earlier  records, 
and  refocusing  attention  under  load  can 
be  helpful  in  Improving  the  memory  per¬ 
formances  of  analysts.  If  such  aids  are 
found  helpful,  what  are  the  Implication* 
for  training  the  managers  of  analytic 
teams,  for  designing  memory  support 
aids  for  analysts,  for  providing  perfor¬ 
mance  feedback  arrangements,  and  for 
training  analysts?  Can  Interpretive  bias 
factors  be  predicted  In  practical  situa¬ 
tions? 

8.2  Management  of  Analytic  Work 

Next  to  the  effective  perform^  nee  of 
the  analyst's  memory,  the  most  critical 
element  for  Improved  analytic  perfor¬ 
mance  appears  to  be  Insightful  and 
effective  management  for  analysts. 
Many  studies  In  the  organizational  and 
management  fields  Indicate  that  the 
beneficial  effects  from  technical  sup¬ 
port  Improvements,  improved  feedback, 
training,  and  selection  can  be  coun¬ 
teracted  by  aome  management  orienta¬ 
tions.  Conversely,  management  that  Is 
Insightful  about  factors  affecting  spe¬ 
cialized  organizational  and  Individual 
performance  may  extemporize  many 
desirable  arrangements  and  procedures. 

Assuming  that  various  parts  of  the  find¬ 
ings  of  this  study  are  validated,  how 
Important  Is  having  knowledge  of  the 
findings  for  managers  of  different  types 
of  analytic  work?  What  management 
approaches  and  practices  for  various 
circumstances  are  implied  by  the 
model?  Of  particular  Interest  are 
memory  management  techniques,  fac¬ 
tors  In.  using  team  memory,  and  safe¬ 
guards  against  decision  pressure. 
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3.3  System  Supports  for  Analytic 
Functions 

Much  Is  already  known  about  the  use¬ 
fulness  of  various  system  supports  for 
analytic  work,  and  It  Is  clear  that 
modem  Intelligence  systema  cannot 
hope  to  perform  all  the  functions 
required  of  them  without  carefully 
planned  and  designed  automated  sup¬ 
ports.  The  general  problems  ct  providing 
non-ob truslve  but  active  me.nory  and 
judgmental  supports  for  analysts  were 
alluded  to  earlier.  The  recent  history  of 
developmental  research  efforts  for 
automated  analytic  aids  Includes  con¬ 
tinuing  efforts  to  provide  not  only  con¬ 
ventional  automated  support  for  data 
and  message  file  *,  but  semi-automatic 
message  handling  and  other  automation 
alme*i  at  forming  and  maintaining 
system-based  versions  of  the  concep¬ 
tual  nodels  (and  Implied  Information 
models)  used  by  analysts.  A  number  of 
questions  regarding  such  supports  are 
prompted  by  the  present  study  findings. 

Static  versions  of  many  conceptual  and 
Information  models  currently  exist  in 
documented  form  (e.g.,  Order  of  Battle, 
Intelligence  Preparation  of  the  Battle¬ 
field).  How  will  dynamically  supported 
versions  of  such  externalized  models 
affect  the  expectations  of  analysts? 
In  what  ways  might  the  models  serve  as 
armatures  for  team  analyses  of  Inter¬ 
pretive  disparities  in  problematic  situa¬ 
tions?  In  such  uses,  under  what  condi¬ 
tions  will  they:  cause  Interference; 
clarify  analytic  alternatives;  support  or 
curtail  productive  hypothesis  genera¬ 
tion;  focus  premature  convergence  on 
Inaccurate  Interpretations;  speed 
correct  Interpretations;  accelerate 
recognition  of  anticipated  events;  delay 
recognition  of  marginally  unusual 
events;  serve  as  high-capacity  formats 
for  transmitting  accurate  Information; 


serve  as  hlflh-capaclty  formats  for 
transmitting  somewhat  Inpccurate  Infor¬ 
mation? 

Such  questions  bscome  even  more  sig¬ 
nificant  In  light  of  the  fact  that  there 
presently  exist  concepts  and  working 
rnodsls  for  various  advanced,  experi¬ 
mental,  computer-based  facilities  for 
conducting  team  judgment  processes 
via  networks  of  CRT  terminals.  Team 
communications  can  be  constrained  to 
any  desired  pattern  through  such  facili¬ 
ties,  and  computer  Information  stores 
and  graphic  capabilities  can  combine  to 
allow  members  to  form  and  display  their 
Individual  hypotheses  to  one  another  tn 
vivid  ways  and  to  overlay  their  vo/'oua 
offerings  to  facilitate  comparisons. 

M  Performance  Feedback  Arrange¬ 
ments  * 

t 

Is  there  something  *x>  be  learned  from 
discarded  Interprs/tatiorr  ?  Post  hoc 
analyses  of  Intelligent  lapses  that 
reach  public  awareness  sometimes 
Include  corollary  "l  told  you  so" 
materiel.  There  Is  no  presently  feasible 
way  to  save  discarded  alternative 
Interpretations  on  a  large  scale,  but  It 
seems  likely  that  these  Interpretations 
would  sometimes  have  proven  more 
accurate  than  the  »'*nea  chosen  for  use. 
Only  large-scale  Inaccuracies  on  Impor¬ 
tant  events  are  likely  to  prompt  post 
hoc  Inquiries,  with  the  result  that 
potentially  superior  but  unused  every¬ 
day  analytic  performances  go  unno¬ 
ticed. 

Yet,  the  cognitive  model  suggests  that 
more  can  be  gained  by  focusing  on  com¬ 
parative  degrees  of  success  than  upon 
scattered  Instances  of  highly  notice¬ 
able  failure.  Deep  cognitive-processing 
rehearsals  of  analytic  failures  will  instill 
highly  accessible  memory  contents 
about  what  not  to  do,  which  can  be 


-8-2- 


very  Important.  Nevertheless,  such  Inhi¬ 
bitory  contents  suggest  t,  e  proper 
ways  to  proceed  only  on  a  default 
basis  (by  exclusion).  A  rapid  and  affec¬ 
tive  response  Is  more  likely  to  be  gen¬ 
erated  by  accessing  memory  materials 
related  to  comparative  successes. 

Can  the  analyst  profit  equally  from 
negative  and  positive  memory  exem¬ 
plars  that  "fit"  a  certain  situation?  It  is 
worth  recalling  that  the  cognitive  model 
Indicates  that  the  Individual  Is  not  free 
to  choose  what  will  be  recalled  In  a 
given  situation:  memory  access  func¬ 
tions  are  mostly  automatic  and  outside 
of  awareness.  What  will  emerge  first 
from  memory  Is  what  has  been  pro¬ 
cessed  most  frequently  and  deeply. 
Since  there  are  many  more  ways  to  do 
a  thing  wrong  than  to  do  it  right,  there 
is  ample  opportunity  to  load  memory 
with  detour  signs  rather  than  positive 
directional  pointers. 

Regarding  feedback  arrangements  from 
a  oosts/beneflts  point  of  view,  part  of 
the  massive  ADP  support  anticipated  for 
analytic  activities  of  the  future  might 
prove  to  be  used  effectively  for  storing 
generated  alternative  Interpretations 
and  automatically  comparing  them  with 
unfolding  events. 

8.5  Training  for  Analytic  Work 

The  study  findings  Indicate  two  main 
points  for  training: 

1.  It  Is  essential  to  consider  the 
analyst’s  detailed  training  require¬ 
ments  from  a  systematic  viewpoint 
of  required  memory  contents  and 
required  memory  functioning.  In 
much  successful  analytic  work,  a 
wider  range  of  memory  contents 
are  used  than  superficially  "meets 
toe  eye.” 


2.  Having  once  learnet.  something 
does  not  neoessarlly  moan  that  It 
will  be  appropriately  accessible 
from  memory  when  needed.  The 
memory  modification  cycle  of  the 
model  shows  that  a  filtering  and 
consolidation  buildup  period  Is 
required,  in  which  earlier  learnings 
are  refreshed  and  configured  to  be 
property  accessible  by  cues  from 
the  ooncrete  analytic  situation  of 
toe  present. 

Moreover,  success  of  the  buildup 
process  is  not  fully  under  aware 
volitional  control  of  the  analyst.  The 
memory  modification  cycle  mechan¬ 
isms  of  filtering,  consolidation,  and 
Interference  will  operate  outside 
awareness  during  the  buildup 
period.  Efforts  must  therefore  be 
made  to  channel  the  results  of 
these  mechanisms  In  desired  direc¬ 
tions. 

8.6  Selection  and  career  manage¬ 
ment 

The  analysts’  self-report  Image  profile 
presented  In  this  report  was  gleanei' 
mostly  from  successful  experienced 
analysts  and  should  be  given  serious 
consideration  as  providing  some  gui¬ 
dance  for  selection  criteria  for 
analysts.  This  Is  especially  true  since 
some  personnel  selection  studies  have 
shown  setf-report  assessments  to  have 
comparatively  good  validity  for  some 
kinds  of  occupations. 

Although  the  study  results  provide  few 
clear  Indications  for  the  more  technical 
aspects  of  selection  procedures,  It 
seems  apparent  that  potential  arr.lysts 
must  be  selected  In  terms  of  demon¬ 
strated  conceptual  abilities,  the  abso¬ 
lute  levels  required  depending  upon  the 
Individual’s  (realistic)  future  aspirations 
for  advancement  to  work  settings 


high*'  in  the  analytic  continuum  I  For 
•any  modern  analytic  tettingi,  *hw:{\ 
science  or  technology  interests  appee  * 
vary  daairabla.  for  others,  a  stronger 
soda]  and  political  science  orientation 
la  needed.  Except  for  assumed  career 
termination  In  the  lowest  "end-of-the- 
plpe"  source  production  work  settings, 
demonstrated  teal  success  In  complet¬ 
ing  High  school  and  Indicated  capacity 
to  do  At  least  beginning-level  college 
work  Is  probably  essential. 

Interest  in  military  science  and  related 
l««sjss  Is  not  an  entry-level  require¬ 
ment,  but  early  clear  signs  of  voluntary 
growing  professional  Interest  In  such 
matters  should  be  a  prerequisite  for 
tagging  candidates  for  advancement 
and  rotation  to  different  and  higher 
dots  within  the  analytic  continuum. 

The  successful  analyst’s  orientation 
toward  ambiguity  Is  at  present  an  open 
Issue.  Tolerance  for  ambiguity  Is  essen¬ 
tial  to  the  analyst  In  dealing  comfortebly 
with  sparse  and  equivocal  data  pat¬ 
terns  associated  with  analytic  work.  On 
the  other  hand,  a  vigorous  natural 
Interest  In  reducing  ambiguity  also 
appears  Important,  ^hia  aspect  of  the 
analyst's  management  and  reworking  of 
internal  memory  contents  appears  to  be 
a  productive  topic  for  Investigations, 
using  the  concept  of  the  contents 
modification  cycle  presented  in  this 
report. 
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2  HQOA  (D^W-CSZ) 

1  HQOA  (OAFS-PIR) 

1  HQOA  <OAMA>A*l 
1  HCOA  (OAFS  HM-ni 
1  HQOA  (tO  40-10) 
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1  HQOA  (QA10F1) 
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t  DCSFf  R,  ATTtl:  CFS/OCP 
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1  The  Army  Ub,  Pentagon.  ATTN:  ANRAl 
1  Ota,  Aaet  beet  of  the  Army  (RftO, 

1  Tech  Support  Ota.  OJCS 
1  UfeAfeA.  Artkigton.  ATTN:  IARO-T 

1  USA  Nadi  Ota,  Outturn,  ATTN:  Uta  Sdanoaa  Sir 

2  USARICM.NoPok.ATTN:  SQRO-Ufe-CA 

1  USATTJ.  Ft  aoyton,  ATTN:  STtTC-MO-A 
1  USAIMA.  Ft  Brags,  ATTN:  ATSUCTO-OM 
1  USA1MA.  Ft  Crsoi,  ATTN;  MoRpiot  Ub 
1  mWACCtrJliSeh.FtMaCMIon.ATTN:  Ub 
1  US  WAC  Ctr  fetch,  Ft  MoCItHen,  ATTN:  Tog  Ok 
1  USA  Quonormeeter  Seh,  Ft  Lee.  ATTN;  ATSM-TC 
t  IntaHipenca  MecnM  Doe  Ota,  SWU  Ft  Hetabfed 
1  USA  SS  Signal  Seh,  Ft  Gordon,  ATCN.  ATSO-SA 
1  USA  Chaplain  Cb  ft  Sdi,  Ft  Hamilton,  ATTN:  ATSC-TtAD 

1  USATSCH,  Ft  CuatH.  ATTN:  tdueAdwxx 

t  USA  War  Cottage.  CarlMa  Sarroeki.  ATTN:  Ub 

2  WRAIR,  Nauropoyehlarry  Ohr 
1  OU.SOA,  Monterey 

1  USA  Concept  A-w  £goy,  Suheeda,  ATTN:  MOCA-MR 
1  USA  Cannpt  Anal  Ayoy,  Inheede,  ATTN:  MOCA-JF 
1  USA  Arctic  Teat  Ctr,  AFOSoettta.  ATTN;  STfACTt-kU 
1  USA  Aretie  Toet  Or,  VO  Seattle.  ATTN:  AMCTl-Fl-TS 
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?  HQUSACOfeC,  Ft  Orb,  ATTN:  Unary 

1  HQUSACOfeC,  Ft  Ort,  ATTN:  ATtC-tX-fe- Hum  Fo 

2  UfeAfefeC,  Ft  feantamki  Harrieor,  ATTN:  library 

1  USAFAOC,  Ft  Saniamki  Harrison,  ATTN:  ATCF— i4R 
t  USA  Contra  feloat  Seh.  Ft  Monmouth.  ATTN:  ATIN-iA 
i  USAIC,  Ft  Monmouth,  ATTN:  Aim  l -CT -HOF 
I  USAIC,  *t  Monmouth,  ATTN:  AMfeil-FA-F 
I  USAFC,  Ft  Monmouth,  ATTN:  AMfef  l-fel-Cfe 
1  USAfeC,  Ft  Monmouth,  ATTN:  C,  Fed  Ooe  fer 
1  USA  Mftertad  feyt  And  4goy.  Aberdeen,  ATTN:  AMXSY-F 
1  Ifemwi  Anew.  Aberdeen,  ATTN:  SANSA-tl-H 
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2  UfeA  Hum  feme  Lob,  Aberdeen,  ATTN:  Library /Dk 

1  UfeA  Combat  Anna  Tag  id.  Ft  feamdnt,  ATTN:  Ad  feuparnbor 
1  UfeA  Infantry  Hum  Radi  Unit,  Ft  borminj.  ATTN:  QM 
1  UfeA  Infantry  Id,  Ft  Banning.  ATTN:  STTBC-TB-7 
1  UfeAfeMA,  Ftfehea,  ATTN:  ATfefe-LRC 
1  ISA  Ak  Oaf  Sdi,  Ft  fefen,  ATTN:  ATtA— CRMK1 
1  USA  Ak  Oof  Sdi,  Ft  Mba,  ATTN:  Teak  lib 
1  USA  Air  Oof  Bd.  Ft  fetka,  ATTN:  FlUtt 
1  USA  Ak  Oof  fed,  Ft  MM,  ATTN:  STfBO-FO 
1  USA  Cmd  fe  Oanaral  Stf  CoMoga,  ft  Uemnwordi,  #n»  TN:  Ub 
I  UfeA  Cmd  >  General  fed  Codeia.  F*  lueetmnrth.  ATTN:  ATfed)  SS-l 
1  UfeA  Cmd  >  Uanaral  fed  Cottage.  Ft  Um  rnnorth,  ATM:  fed  Adebar 
1  UfeA  Combined  Arme  Cmbt  Ooe  Act,  Ft  looeaniifarth,  ATTN:  PagCdr 
1  USA  Conddnad  Aetna  Cmbt  Oa*  Act.  Ft  LaoMnwanh,  ATTNt  CIS 
t  USA  Contained  Aetna  Cmbt  Pee  Am.  Ft  LanannanH.  ATTNt  ATCAfeA 
1  UfeA  Combined  Arme  Cmbt  Dm  Ace.  Ft  lea—wegruh.  ATTN:  ATCACO-S 
>  UfeA  Corabkiad  .Praia  Cmbt  Ooe  Act.  Ft  f.aaramxgedi,  ATTN:  ATCAOC-Q 
I  UBACCOM.  Night  Vidor,  Lab.  Ft  Meek.  ATTN:  AMHL-NV-feD 
}  UfeA  Computir  fere  Cmd,  Ft  fakndr,  ATTN:  Taah  library 
1  UfeAMCROC,  Ft  feeieok ,  ATTN:  -STIFfe— OQ 
t  USA  5ng  Seh,  Ft  Betook,  ATTN:  library 
1  USA  Topographic  Ub,  Ft  boh  ox.  ATTN:  STU-TD-S 
1  USA  Topographic  Ub,  Ft  Batrak.  ATTN:  STINFO  Cantor 
1  UfeA  Tepayaphle  Ub.  Ft  feataok,  ATTN:  STl-QSL 
1  USA  IneaMgraaa  Ctr  fe  Seh,  Ft  Huediuaa.  ATTN:  CTO— Ml 
1  USA  Inartttginei  Car  fe  Seh,  Ft  Huadwea,  ATTN:  ATS—CTD  MS 
1  USA  I  nnHIgaree  Car  fe  Seh,  Ft  Huoahuaa.  ATTN:  ATM— TS 
1  UfeA  IneeWgmca  Ctr  fe  Seh.  Ft  Huechuaa.  ATTN:  ATM-TIX-OS 
1  UfeA  InwWgwtoa  Ctr  fe  feeh.  Ft  Huanhuaa.  ATTN:  ATfet-CTfe-OR 
1  UfeA  InbdOpwoo  Ctr  fe  fech.  Ft  Huaatana,  ATTN:  ATM— CTO— CT 
1  USA  InaeWgraea  Car  ft  fech.  Ft  Huaehuoo,  ATTN:  ATM-CTD-CS 
1  USA  IntaMggnoe  Ctr  fe  (oh.  Ft  Huaehuoo,  ATTN:  DAS/feftO 
1  USA  IneadlgeneB  Ctr  fe  Seh,  Ft  Huaehuoo,  ATTN:  ATM— TIM 
’  USA  InaoMtgonBO  Ctr  fe  Seh,  Ft  Huodiuoa,  ATTN:  Ubrary 

1  COR,  HQ  Ft  Huoohuip,  ATTN:  Toeh  Hoi  Ok 

2  COR.  UfeA  SWotronic  Prui  Ord.  ATTK:  feTSV-MT-fe 
I  Ha  1CATA  ATTN:  Tech  Ubrary 

1  Ha  TCATA.  ATTN:  AT  CAT-OF-Q,  Ft  Hsod 
1  UfeA  fcoruidng  Cmd,  Ft  Meriden,  ATTN:  USARSFM# 

1  fender  Army  Adr^UfeAFAOOOfTAC.BglnAF  Aux  FM  tCa,fe 
1  Ha  U9AMFAC.  DCfeFIR,  AFO  SF  SfefefeS,  ATTN:  OK<«-ea 
1  3  Jrmon  lib,  Aontamy  r<  HadW  feoenoot.  Ft  Sam  Houoaan 
1  Marina  Carpi  I  net,  ATTN:  OonifetCI 
1  Ha  U9MC,  Coramondont,  ATTN:  Cede  MTMT 

1  Ha  UfefeiC,  Conwnndnit.  ATTN.  Cei*  MF1-TO-2S 

2  USCC  Academy.  Nan  londun,  ATTN:  Admitdon 
2  UfeCO  Agadtmy,  Nan  London,  ATTN:  Ubrary 

1  USM  TroMny  Ctr,  NY,  ATTN:  CO 
1  UfeCO  Training  Cb,  NY,  ATTN:  Fdue  Sue  Ota 
1  U.'CO,  Feyehat  Ret  fer,  DC,  ATTN:  UF  f  M2 
1  H3  MU-ftange  fer,  MC  Dot,  OMndeo,  ATTN:  FfeF  Okr 
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1  US  M«nw  Com  Liaseon  Ofe.  AMC,  Alexandria.  ATTN:  AMCOS-F 
t  USATRAOOC,  Ft  Monro*.  ATTN:  ATRO-EO 
«  USATRAOOC.  Ft  Monro*.  ATTN:  ATT* -AO 
I  USATRAOOC.  Ft  Mmo*.  ATTN:  ATTS-SA 
t  USA  Force*  Oml,  Ft  MtFriaraon.  ATTN:  Library 
3  USA  Aviation  Teat  Bd,  Ft  Fuckar.  ATTN:  STESG-FO 
I  USA  A*cy  for  Aviation  Safety.  Ft  Rucktr,  ATTN:  Library 
1  USA  Afcv  far  Aviation  Safety,  Ft  Ruckar,  ATTN:  Educ  Advito r 
1  USA  Aviation  Scb.  Ft  Rudbar.  ATTN:  FO  Drawer  O 
t  HQUSA  Aviation  Syt  Oml,  St  Louie.  ATTN:  AMSAV-2DR 
3  USA  Aviation  Sr*  Taat  Act.  Edwards  AF*.  ATTN:  SAVTt-T 
1  USA  Air  0*f  SFi.  Ft  BUss.  ATTN:  ATSA  TtM 
1  USA  Air  Mobility  Rath  *  Oav  Lab.  Moffett  FM.  ATTN:  SAVOL-AS 
I  USA  Aviation  Sds,  feta  Tn*  Mft,  Ft  ftuefcar,  ATTN:  AT5T-T-RTV 
t  USA  Aviation  Safe,  CU.  Ft  Rucbar.  ATTN:  ATST-O— A 
1  HQ,  OARCOM.  Alexandria.  ATTN:  AMXCO-TL 
1  Ha  OARCOM.  Ataaandria.  ATTN:  COR 
I  US  Military  Acataaay,  Sfeat  Feint,  ATTN:  Sariab  Unit 
1  US  MHinry  Acadaany.  Ffeat  Mot,  ATTN:  Of*  of  MiK  Ldnrip 
1  US  Military  Academy,  Watt  Feint.  ATTN:  MAOR 
1  USA  Standardization  Op.  UK,  FFO  NY,  ATTN:  MASS-OC 
t  Ofe  of  Kami  Ran.  Aril inga&n,  ATTN:  Coda  *83 
3  Ote  of  Naval  Rtcri.  Arlington.  ATTN:  Coda  4SS 
1  Ofcof  Naval  Ran.  Arttn*ton,  ATTN:  Coda 480 
1  Ofe  of  Naval  Rads.  Arlington.  ATTN:  Coda  441 
1  Naval  Aarotae  Mad  Hr*  Lab,  Rmaaoola.  ATTN:  Aeout  Sab  Oiv 
1  Naval  Aaroatfe  Mad  Nw  Lab.  Fanaacoia.  ATTN:  Coda  LSI 
1  Naval  Aaravpc  Mad  Rat  Lab,  Fanaacoia.  ATTN:  Coda  LS 
1  Chief  of  NavFan.  ATTN:  Fan-OR 
1  NAVAIRSTA.  Norfofe.  ATTN:  Safety  Ctr 
1  Nav  Ocaenograpriic.  PC  ATTN:  Cod*  8381.  Chart*  >  Tacri 
1  Can  tar  of  Naval  Aatal,  ATTN:  Ooc  Car 
1  NarAirSvaCom.  ATTN:  AIR-SS13C 
1  Nav  BuMad.  ATTN:  713 
1  NavHatieoptarfeabSqua  2.  FFO  SF  98*01 
1  AFHRL  (FT)  VMiaint  AFS 
1  AFHRL  ITT)  LovaryAFS 
t  AFHRL  (ASI  KfFAFB.  OH 
3  AFHRL  IOOJZ)  Srookt  AFB 
1  AFHRL  (OOJNI  Lackland  AFS  - 
I  HQUSAF  (INYSOI 
1  HQUSAF  (OFXXAI 
I  AFVTG IROI  Randotoh  AF8 
3  AMRL  (HE)  VlFAFB,  OH 
3  AF  imt  of  Tach.  WFAFS.  OH.  ATTN:  ENE/SL 
1  ATC  (XFTOI  Randotpri  AFB 

1  USAF  AaroMad  Ub.  Brookt  AFB  (SUL-4).  ATTN:  DOC  SEC 
1  AFOSR  (NLI.  Arlington 

1  AF  Lid  Cmd.  MeClallan  AfS,  ATTN:  ALC/OFCRB 
1  Air  Foret  Acadamy,  CO.  ATTN:  Dapt  of  Bal  Sen 
8  NavFan  t  Oat  Ctr.  San  Diayo 

3  Navy  Mad  NauropaycMatric  Rtcri  Unit.  San  Oi*|0 
1  Nav  Electronic  Lab,  San  OlayD.  ATTN:  Rat  Lab 

I  Nav  Tm*Can.  San  Ofego.  ATTN:  Cod*  8000-Lib 
l  NavFoatGraSch,  Monterey.  ATTN:  Coda  SSAa 
1  NavFottGraSch,  Montaray,  ATTN:  Coda  3134 
1  NtvTfflfEquipCtr.  Orlando.  ATTN:  Tacri  Lib 
1  US  Oapt  of  Labor.  OC.  ATTN:  Manpovyar  Admin 
I  US  Oapt  of  Juabca.  DC.  ATTN:  Orug  Enforca  Admm 
I  Nat  Bur  of  Standard*,  OC.  ATTN:  Computar  Info  Section 
t  Nat  Oaariny  Houaa  for  MH-Info.  Rockville 
1  Danvar  Ftdatai  Ctr.  Lakavvood.  ATTN:  BLM 
13  Oifart**  Oocumantadan  Canter 

4  Oir  Rtvch,  Army  Hfj,  Rutaail  Ofe*.  Canberra 

I  Scientific  Act  nr,  Mil  Bd,  Army  Ho,  RuaatH  Ofe*.  Canberra 
I  Mil  and  Air  Attach*,  Austrian  Embeerr 
I  Centra  da  Racriatcria  Oat  Faeteun.  Humbn*  da  la  Oafvrna 
National*.  Snntab 
3  Canadian  Joint  Staff  Washington 
I  C'Air  Staff,  Royal  Canadian  AF.  ATTN:  Pan  Std  Anal  Br 

3  Chief.  Canadian  Oaf  Rscri  Staff.  ATTN:  C'CROSfW) 

4  British  Oaf  Staff.  British  Embasay,  Washington 


I  Oaf  B  Civil  Inn  of  Enviro  Madlclna.  Canada 
I  AIR  CRESS,  Kanalrsgton.  ATTN:  Info  Sya  Sr 
I  MUItaerptyfcologltit  Tlanaata.  Capanriapps 
1  Military  Attach*,  French  Embasay.  ATTN:  Ooc  Sac 
I  Madectn  Chef.  C.E.R.P.A. -Arsenal.  TouMru Naval  Franc* 
I  Frin  Soantific  ON,  An"  Hum  Enp  Rads  ON,  Ministry 
of  Defers**,  Nav*  Oairi: 

t  Fort  Rach  Ofe  Library,  AKA.  Inal  Defense  Forms 
t  Minittaria  van  Otfenait.  DOOF/KL  Afd  Sodaal 
Ftydiolooi  eerie  Zafcan,  Trie  Hague,  Netherlands 
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